Three-dimensional virtual input and simulation apparatus

ABSTRACT

The present invention relates to a three-dimensional virtual input and simulation apparatus, and more particularly to an apparatus comprising a plurality of point light sources, a plurality of optical positioning devices with a visual axis tracking function, and a control analysis procedure. The invention is characterized in that the plurality of optical positioning devices with the visual axis tracking function are provided for measuring and analyzing 3D movements of the plurality of point light sources to achieve the effect of a virtual input and simulator.

CROSS REFERENCE TO RELATED PATENT APPLICATION

This is a divisional application of an application Ser. No. 12/184,475filed on Aug. 1, 2008.

FIELD OF THE INVENTION

The present invention relates to a three-dimensional virtual input andsimulation apparatus, and more particularly to an apparatus comprising aplurality of point light sources, a plurality of optical positioningdevices with a visual axis tracking function and a control analysisprocedure. The invention is characterized in that the plurality ofoptical positioning devices with the visual axis tracking function areprovided for measuring and analyzing 3D movements of the plurality ofpoint light sources to achieve the effect of a virtual input andsimulator.

BACKGROUND OF THE INVENTION

The major characteristic of a general traditional man-machine interfacesuch as a keyboard, a mouse, a joystick, a remote control, and a touchscreen is that users must use a hand and fingers to touch the mechanicalstructure of a device for inputting related information including thetexts, graphics and other operating instructions to the machine, so asto achieve the effect of man-machine interactions.

In the present invention, the virtual input apparatus is basicallydefined to use a 3D movement of hand as an inputting method to achievethe effect of inputting information including texts, graphics, andoperating instructions. In other words, the 3D hand's movement is usedas a man-machine interactive interface.

With reference to FIG. 1 for the schematic view of a virtual reality(VR) glove, the VR glove 1 is a typical device of 3D hand's movementrecognition. In order to detect fine movements of fingers of a hand, ageneral VR glove usually installs a strain gage sensor or a flex sensor(not shown in the figure) at the positions of fingers 2 to measure thephysical quantity of bent fingers. In order to pursue the effect offorce feedback, the VR glove usually adopts various micro actuators (notshown in the figure). Finally, the VR glove installs a positioningdevice 3 for measuring the 3D coordinates and orientation of a singleposition of the glove. Refer to the following related patents fordetails.

U.S. Pat. No. 4,414,537 (Gray J. Grimes, 1983)

U.S. Pat. No. 5,047,952 (James P. Kramer, 1991)

U.S. Pat. No. 4,988,981 (Tomas G. Zimmerman, 1991)

Although the VR glove has achieved the man-machine communicationseffect, the structure and control of the VR glove are still toocomplicated and not applicable to the personal computers, game players,PDAs, mobile phones, and home video equipments that require simpleinterface operations. Furthermore, the manufacturing cost is relativelyhigh and not affordable by general users, and thus the VR glove is notpopular in the consumer market. As to the technology, the positioningdevice used in the VR glove is nothing more than an electromagnetic orultrasonic device to avoid interference from the hand's movements, butsuch position device has drawbacks such as a low response speed thatcauses an obvious latency in practical operations and a lowresistibility of environmental interference. Refer to the followingresearch reports for the details.

Christine Youngblut, etc., Review of Virtual Environment InterfaceTechnology, Chapter 3 and 5, INSTITUTE FOR DEFENSE ANALYSES, 1996

For any virtual input apparatus, a positioning sensor for rapidlyrecognizing the movements of multiple points on a hand is the primarycondition for achieving the virtual input effect. Based on theaforementioned reason, the positioning sensor must have the followingcharacteristics to achieve the practical and popular purpose.

1. The positioning sensor must be able to provide physical quantities(including space coordinates, displacement, velocity and acceleration)of the 3D movements of multiple points of a hand.

2. The positioning sensor must be able to detect a large spatial volume,such that users are allowed to move their hands freely in a relativelarge space.

3. The positioning sensor must have a visual point tracking capabilityfor automatically tracking the operating position of a user andproviding a larger space of operation.

4. The positioning sensor must have a capability of high spatialresolution. The smallest sensible displacement must be up to the orderof millimeters in a space where users move their hands.

5. The positioning sensor must have a capability of quick response. Theshortest responsible time for detecting the physical quantity of 3Dmovements of the users' hands must be up to the order of milliseconds inthe time frame.

6. The manufacturing cost of the positioning sensor must be as low as aregular computer peripheral.

Based on the foregoing required conditions, the degree of performanceachieved by the prior arts is examined. In the past, the technologiescapable of measuring the physical quantity of a single-point 3D movementinclude static electric field, static magnetic field, ultrasonic wave,electromagnetic wave, and trigonometric methods as disclosed in thefollowing related patents:

Static Electric Field Method: U.S. Pat. No. 6,025,726 (Neil Gershenfeld,2000)

Static Magnetic Field Method: U.S. Pat. No. 4,945,305 (Ernest B. Blood,1990)

Ultrasonic Wave Method: U.S. Pat. No. 5,214,615 (Will Bauer, 1993)

Electromagnetic Wave Method: U.S. Pat. No. 4,613,866 (Ernest B. Blood,1986) and U.S. Pat. No. 5,739,812 (Takayasu Mochizuki, 1998)

Trigonometric Method—Image Processing (2D Camera): U.S. Pat. No.4,928,175 (Henrik Haggren, 1990) and U.S. Pat. No. 6,810,142 (NobuoKochi, 2004)

Trigonometric Method−2D Optical Method: U.S. Pat. No. 5,319,387 (KouheiYoshikawa, 1994)

The aforementioned technologies more or less cannot satisfy therequirements of a high spatial resolution, a high-speed response, alarge detectable volume and a low manufacturing cost, and suchtechnologies are not the subjects for discussion in the presentinvention. The technology explored by the present invention is thepositioning technology based on 1D optics. Unlike the aforementionedtechnologies, the 1D optical positioning technology can satisfy allrequirements of high spatial resolution, a high-speed response, a largedetectable volume and a low manufacturing cost. Issued patents of therelated 1D optical positioning technology are listed as follows:

U.S. Pat. No. 3,084,261 (Donald K. Wilson, 1963)

U.S. Pat. No. 4,092,072 (Stafford Malcolm Ellis, 1978)

U.S. Pat. No. 4,193,689 (Jean-Claude Reymond, 1980)

U.S. Pat. No. 4,209,254 (Jean-Claude Reymond, 1980)

U.S. Pat. No. 4,419,012 (Michael D. Stephenson, 1983)

U.S. Pat. No. 4,973,156 (Andrew Dainis, 1990)

U.S. Pat. No. 5,198,877 (Waldean A. Schuiz, 1993)

U.S. Pat. No. 5,640,241 (Yasuji Ogawa, 1997)

U.S. Pat. No. 5,642,164 (Yasuji Ogawa, 1997)

U.S. Pat. No. 5,907,395 (Waldean A. Schuiz, 1999)

U.S. Pat. No. 5,920,395 (Waldean A. Schuiz, 1999)

U.S. Pat. No. 6,584,339 B2 (Robert L. Galloway, 2003)

U.S. Pat. No. 6,587,809 B2 (Dennis Majoe, 2003)

U.S. Pat. No. 6,801,637 B2 (Nestor Voronka, 2004)

U.S. Pat. No. 7,072,707 B2 (Robert L. Galloway, 2006)

The positioning technology based on the 1D optics was first disclosed inU.S. Pat. No. 3,084,261 (Donald K. Wilson, 1963). Wilson used twoperpendicular 1D cylindrical lenses (or simply referred to as 1Dlenses), two triangular and two square silicon photovoltaic cells toachieve the effects of measuring the azimuth and elevation of the sunand automatically tracking the movement of the sun. In 1978, Ellis usesa V-shaped aperture and a linear array of light sensitive elements toachieve the same effect of angular measurement.

In 1980, Reymond first proposed the 3D coordinates positioningtechnology based on the 1D optics and the major features of thetechnology are given below:

1. Assembly of Optical System

The optical system comprises three linear positioning sensors composedof a 1D lens, a filter, a linear array of photosensitive elements, and alinear array of photosensitive element signal read circuits, and amethod of spatial coordinate calculation. In the spatial arrangement ofthree linear positioning sensors, the long axes of the linear array ofphotosensitive elements are disposed at a common plane, and thedirection of the long axes of the first and second linear arrays ofphotosensitive elements are parallel, but the direction of the long axesof the first (second) linear positioning sensor is perpendicular to thedirection of the long axes of the third linear positioning sensor.

Theory of Computing 3D Coordinates

The theory of computing 3D coordinates is provided under a condition ofthe aforementioned common plane. In this method, the positions of ameasured point light source, central axis of 1D lens, and imagepositions of three linear sensor arrays constitute three geometricplanes, and the intersection point of three planes can be used forobtaining the coordinates of the point light source.

3. Multi-Point Positioning Effect

The lighting of multiple point light sources is switched alternately andperiodically, such that each point light sources will emit light atdifferent time to prevent the image overlapped phenomenon and obtain thecorrect image corresponding relation among three linear positioningsensors (hereinafter, this technology is referred to as time modulationmethod for simplicity), so as to achieve the positioning purpose ofthree point light sources.

4. Signal Process of Measured Data

In the signal reading circuit of a linear sensor array, a thresholdcomparison circuit is installed to remove unnecessary background light.

In addition, the Reymond's patent also mentioned possible extension ofthe technology (but not discussed and claimed in the patent) as follows:

5. Extension of Measuring More Points

As to the position measurement of more points, the number of linearpositioning sensors can be increased to achieve the positioning purposeof more points.

6. Extension of Spatial Arrangement

As to the arranged positions of the linear sensor arrays, it is notnecessary to arrange the linear sensors in a common plane.

For the aforementioned two extensions, Reymond has not taught anytheoretical calculation for obtaining the space coordinates of thetesting points.

As to the positioning of a 3D point, Reymond's patent fully disclosesthe principle, architecture and basic technology of the 1D opticalpositioning system. Later patents, from the patent disclosed byStephenson in 1983 to the one disclosed by Galloway in 2006, generallycontinued using Reymond's principle and architecture and their isapplications remained in the measuring area without specialbreakthroughs as described below.

U.S. Pat. No. 4,419,012 (Michael D. Stephenson, 1983)

Basically, this patent is an improvement of a portion of Reymond'spatent, and the Stephenson's patent is characterized in the improvementof a synchronization method. In other words, Reymond adopted a wiremethod to achieve the synchronous purpose between the lighting timing ofpoint light sources and the scanning timing of the linear sensor array.Stephenson adopted a pin diode to monitor the lighting timing of eachpoint light source, so as to synchronously start the scanning timing ofthe linear sensor array, and thus Stephenson uses a wireless method toachieve the effect of synchronization.

U.S. Pat. No. 4,973,156 (Andrew Dainis, 1990)

Dainis' patent almost adopted the whole concept of Reymond's patent.Although Dainis disclosed a common plane with an angle of 120° for thespatial arrangement of three linear positioning sensors and a commonplane with an angle of 45° for the spatial arrangement of four linearpositioning sensors, Dainis did not give the detailed theoreticalcalculation for these two spatial arrangements. In addition, although asimultaneous illumination of multiple points has been mentioned, thephysical implementation and method are not taught. Further, as to theimage overlapped phenomenon (as disclosed in R.O.C. Pat. ApplicationNo.: 096113579), no discussion in this regard has been found.

U.S. Pat. No. 5,198,877 (Waldean A. Schuiz, 1993)

Basically, Schuiz's patent is an application of Reymond's patent, whichuses a hand-held 1D laser scanner which scans and projects a linearlaser light spots onto a surface of the testing object, and two sets oflinear positioning sensors are used for obtaining the relativecoordinates of the laser light spots reflected by the testing object,and then three sets of Reymond's linear positioning sensors are used tomeasure three pilot light emitters installed on the laser scanner, andfinally the absolute coordinates of the laser light spots reflected bythe testing object can be calculated. Regarding the lighting of multiplepoint light sources, Schuiz adopts Reymond's method without anyinnovation. As to the lighting of three pilot light emitters, althoughSchuiz has mentioned, but not claimed, the way of using a light sourcewith a different wavelength (or different color) and a light source witha different frequency modulation, physical implementations have not beentaught.

U.S. Pat. No. 5,640,241 (Yasuji Ogawa, 1997)

U.S. Pat. No. 5,642,164 (Yasuji Ogawa, 1997)

Basically, Ogawa's two patents, which are improvements of a portion ofReymond's patent, have the major characteristic of using a 2Dphotosensitive array and a combined type 1D lens with the advantage of areduced simple mechanism, but cannot improve the spatial resolution ofany measurement (Note: the resolution does not rely on the use of 1D or2D photosensitive array, but relies on the size of single pixel on thephotosensitive array, the optimization of the point light source, andthe setting of other optical parameters), and cannot improve thesampling rate (Note: the use of 2D photosensitive arrays only reducesthe sampling rate), and cannot lower the manufacturing cost (Note: thecombined type 1D lens incurs a high manufacturing cost), and have nodescription about the signal processing of the measured data and thedeal with a plurality of points.

U.S. Pat. No. 5,907,395 (Waldean A. Schuiz, 1999)

U.S. Pat. No. 5,920,395 (Waldean A. Schuiz, 1999)

Basically, these two patents are applications of Reymond's patent and asupplement for a small portion of Reymond's patent. The supplementresides in the improvement of the point light source. In other words, aspherical or planar diffuser is used for obtaining a point light sourcewith a larger diffusion angle. As to the processing of background light,a software method is used, wherein a signal of the background light isrecorded into a memory, and the background light is subtracted from ameasured signal in an actual measurement to obtain the original signal.As to the method of lighting up the plurality of point light sources,Reymond's method is adopted without further innovation.

U.S. Pat. No. 6,584,339 B2 (Robert L. Galloway, 2003)

U.S. Pat. No. 6,801,637 B2 (Nestor Voronka, 2004)

U.S. Pat. No. 7,072,707 B2 (Robert L. Galloway, 2006)

Basically, the aforementioned three patents are applications ofReymond's patent, which have no innovation on the positioningtechnology.

In summary of the aforementioned patents, we can draw the followingconclusions:

(1) Theoretical Calculation

As to the theoretical calculation of the 3D coordinates of the pointlight source, no new theory is provided other than the simpletheoretical calculation provided by Reymond's patent. In the academicfield, the following related theses were published: Yasuo Yamashita,Three-dimensional Stereometeric Measurement System Using OpticalScanners, Cylindrical Lenses, & Line Sensors, SPIE 361, August 1982.

The theory described by Yamashita is applicable only if the direction ofa long axis of the linear sensor array is arranged on a common plane,and the optical axis of the 1D lens optical axis is arranged on a commonplane. Yamashita's theory is not a general theory of 3D positioning Ageneral theoretical calculation developed for the linear positioningsensors with the arbitrary arranged position and orientation has beendisclosed by the following patents:

R.O.C. Pat. Application No.: 096108692

R.O.C. Pat. Application No.: 096113579

R.O.C. Pat. Application No.: 096116210

(2) Technology

The prior arts disclosed in the foregoing patents cannot break throughthe patent claims of the Reymond (1980). Particularly for the imageoverlapped phenomenon, no improvement or innovation was made after theStephenson's patent (1983).

(3) Application

All foregoing patents are applied for the 3D position measurement, butnone of the foregoing patents has disclosed the application of a virtualinput. R.O.C. Pat. Application No.: 096116210 has disclosed the use ofthe 1D optical positioning technology for the application of virtualinput, and this patent first disclosed a 3D mouse which uses gestures toachieve the purpose of man-machine interface.

SUMMARY OF THE INVENTION

Therefore, it is a primary objective of the present invention toovercome the shortcomings of the prior art by providing athree-dimensional virtual input and simulation apparatus. The featuresand advantages of the present invention will become apparent from thefollowing detailed description taken with the accompanying drawing.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows the schematic view of a virtual reality (VR) glove;

FIG. 2 shows the schematic view of the image overlapped phenomenon of a1D optical system;

FIG. 3( a) shows the schematic view of an image of a point light sourceformed by a 1D optical lens;

FIGS. 3( b)˜3(e) show the schematic view of the intensity modulationmethod;

FIGS. 3( f)˜3(i) show the schematic view of the geometric modulationmethod;

FIG. 3( j) shows the schematic view of the deduction method and GaussianFitting for finding the mean position;

FIG. 4( a) shows the synchronous timing of Stephenson's time modulationmethod;

FIG. 4( b) shows the asynchronous problem of Stephenson's timemodulation method;

FIG. 4( c) shows the schematic view of the improved Stephenson's timemodulation method;

FIG. 4( d) shows the schematic view of the Master/Client WirelessSynchronization Method;

FIG. 4( e) shows a different application of the Master/Client WirelessSynchronization Method;

FIG. 5( a) to FIG. 5( c) show the schematic view of the currentlypopular image sensing art;

FIGS. 5( d) and 5(e) show the schematic view of the wavelengthmodulation method;

FIG. 5( f) shows the schematic view of a 1D three color optical sensorarray;

FIGS. 5( g) and 5(h) show the arrangement of RGB color filters in a 2Dcolor CCD or CMOS optical sensors array;

FIG. 5( i) shows the schematic view of the random access scanningprocess in a 2D color optical sensors array;

FIGS. 5( j) and 5(k) show the schematic view of the hardware method foreliminating the dynamic background light interference

FIGS. 6( a) and 6(b) show the light emission spectrum both offluorescent and Halogen lamp;

FIG. 7( a) shows the schematic view of an optical system adopted byReymond;

FIG. 7( b) shows the change of image signal due to the tiny displacementof a point of light source;

FIG. 8( a) shows the schematic view of the maximum viewing angle of a 1Doptical positioning system;

FIG. 8( b) shows the schematic view of the solution of a blind spot;

FIG. 8( c) shows the schematic view of a method of viewing angleexpansion;

FIG. 8( d) shows the schematic view of a visual axis tracking method;

FIG. 8( e) shows the schematic view of a 1D optical positioning systemhaving the functions of rotating the visual axis and being positioned;

FIG. 9( a) shows the schematic view of an application of a generalmouse;

FIG. 9( b) shows the schematic view of a mouse simulated input method;

FIG. 9( c) shows the schematic view of a remote control simulated inputmethod;

FIG. 9( d) shows the schematic view of a touch screen simulated inputmethod;

FIG. 9( e) shows the schematic view of a keyboard simulated inputmethod;

FIG. 10 shows the schematic view of the first preferred embodiment inthe present invention;

FIG. 11( a) shows the schematic view of a plurality of point lightsources with intensity unique characteristics;

FIG. 11( b) shows the schematic view of a plurality of point lightsources with geometric unique characteristics;

FIG. 11( c) shows the schematic view of an assembly of a single pointlight source;

FIG. 11( d) shows the schematic view of a light scattering component;

FIGS. 11( e)˜11(n) show the objects for installing the point lightsources;

FIG. 12( a) shows the schematic view of a single 1D optical positioningdevice with visual axis tracking function;

FIG. 12( b) shows a virtual coordinate system set in a 1D opticalpositioning device;

FIG. 12( c) shows a coordinate relationship between the master andclient 1D optical positioning device;

FIG. 12( d) shows the schematic view of a linear positioning sensorassembly;

FIGS. 12( e)˜12(i) show the geometric structural relation of the 1Doptical positioning device fixation mechanism, the linear positioningsensor fixation mechanism and the pilot point light sources;

FIG. 12( j) shows the casing of other conventional device for theinstallation of the linear positioning sensor fixation mechanism;

FIG. 13( a) shows a schematic view of a control analysis procedure;

FIG. 13( b) shows a schematic view of a coordinate alignment andsynchronization calibration procedure;

FIG. 14 shows the schematic view of the second preferred embodiment inthe present invention;

FIG. 15( a) shows the schematic view of the third preferred embodimentin the present invention;

FIG. 15( b) shows the schematic view of a module device of multiplepoint light sources in the third embodiment;

FIG. 15( c) shows the schematic view of a 1D optical positioning deviceswith visual axis tracking function in the third embodiment;

FIG. 16 shows the schematic view of the fourth preferred embodiment inthe present invention;

FIG. 17 shows the schematic view of the fifth preferred embodiment inthe present invention

FIG. 18 shows the schematic view of the sixth preferred embodiment inthe present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENT

To overcome the shortcomings of the prior art, the present inventionprovides following innovations and improvements.

1. Process of Unique Characteristics of Point Light Sources

2. Process of Background Light Interference

3. Process of Measurement Data

4. Extension of System Configurations

5. Extension of System Applications

Finally a detailed description of preferred embodiments is provided.

1. Process of Unique Characteristics of Point Light Sources

The advantage of the 1D optical system resides in its quick reading ofan image point position (due to the use of the linear optical sensorarray), but the disadvantage resides in its easily produced imageoverlapped phenomenon. With reference to FIG. 2 for the schematic viewof the image overlapped phenomenon of a 1D optical system, the focusingdirection of a 1D lens 5 with a focal length f is parallel to the y-axis(wherein the short line with a double-arrowed head in the figureindicates the 1D lens, and the direction of the arrowhead indicates thefocusing direction), and the direction of a long axis is parallel to thex-axis, and the optical axis is parallel to the Z-axis. A straight lineP₁P₂ perpendicular to the y-axis lies on the plane which is allocatedalong the optical axis Z and perpendicular to the optical axis Z, suchthat the image position of a point light source o(x₁, y₁, z₁) at anyposition on the straight line P₁P₂ is I(0, y_(s), 0), which indicates animage overlapped phenomenon, and the straight line P₁P₂ is hereinafterreferred to as an image overlapped line. In other words, any point lightsource on the straight line P₁P₂ has the same image position. Therefore,if a positioning system using a 1D optical system to measure themultiple point light sources, the most concerning issue is to overcomethe image overlapped phenomenon. In addition, as to multiple point lightsources, because the least number of used linear optical sensor array isthree in present technology, a recognition procedure must be used tofind the correct corresponding relation of images among the linearoptical sensor arrays rapidly and correctly, so as to achieve the rightpositioning measurement of a plurality of point light sources.

Letting each point light source have a unique characteristic is thebasic principle of overcoming the image overlapped phenomenon andobtaining the correct image corresponding relationship. As disclosed inthe foregoing U.S. patent that performs time modulation, or wavelengthmodulation, or frequency modulation to a plurality of point lightsources, such that each point light source has a unique characteristic.The time modulation refers to a method that lights each point lightsource continuously and alternately. In other words, each point lightsource is lit at different time. Therefore, each scanning at a detectingend reads the image position of the one and only one lit point lightsource. The drawback of the time modulation is the positioningmeasurement error caused by the asynchronous problem, and the error isproportional to the velocities and number of point light sources. Thewavelength modulation refers to a method that allows each point lightsource to have a different light emitting wavelength. The drawback ofwavelength modulation is the increase of manufacturing cost and thevolume of data processing. The frequency modulation refers to a methodthat allows a light emitting intensity of each point light source tooscillate at a different frequency. The drawback of frequency modulationis the use of demodulation technology. Unlike the aforementionedprocessing arrangement, R.O.C. Pat. Application No.: 096113579 alsodiscloses a method of increasing the number of 1D positioning sensor anda method of optical axis rotation for overcoming the image overlappedphenomenon.

In the present invention, as to the gesture recognition and itsapplications, the following methods such as (1) intensity modulation,(2) geometric modulation, (3) improvement of Stephenson method, (4)master/client wireless synchronous method and (5) wavelength modulationprovided for overcoming the image overlapped phenomenon are disclosed.

(1) Unique Characteristics of Light Intensity and Geometric Structure ofPoint Light Sources

With reference to FIG. 3( a) for the schematic view of the image of apoint light source formed by a 1D optical lens, generally a line image11 is obtained when the emitting light of a point light source 10 istransformed by a 1D optical lens. The line image 11 is read by a linearsensor array 12, and an image signal I(x) with an intensity which isclose to a Gaussian distribution as shown below is obtained in itstransversally distributed direction of the line image.

$\begin{matrix}{{I(x)} = {I_{0}^{- \frac{{({x - \mu})}^{2}}{2\sigma^{2}}}}} & (1)\end{matrix}$

Where, I₀ is the central intensity, σ is the standard deviation, and μis the mean position. Generally, I(x) is close to zero when the positiondeviation of x is larger than 3σ. Therefore, an effective image signalcan be defined by the signal obtained at |x−μ|<3σ. The light emittingpower P of the point light source 10 can determine the central intensityI₀, and the magnitude r of the point light source will change thestandard deviation σ. Therefore, I₀ and σ of the point light source canbe used as the parameters with the unique characteristic. In otherwords, as to a plurality of point light sources, different I₀ and σ canbe used to identify a plurality of point light source. The method ofusing I₀ for identifying a point light source is hereinafter referred toas an intensity modulation method, and the method of using σ foridentifying a point light source is hereinafter referred to as ageometric modulation method.

Three point light sources are used as an example for illustrating theintensity modulation method and the geometric modulation method asfollows.

(1) Intensity Modulation Method

With reference to FIGS. 3( b) to 3(e) for schematic views of theintensity modulation method, FIG. 3( b) shows that, in case of no imageoverlapped phenomenon occurred, three point light sources with differentintensities I₀, I₀₂, I₀₃ but same standard deviation σ form the imagesignals 15, 16, 17 on the linear sensor array respectively. According tothe unique central intensity, a threshold method or profile detectionmethod (refer to the description below) is used to identify these imagesignals 15, 16, 17 easily and obtain the mean positions of each imagesignals. If three point light sources approach the image overlapped lineas shown in FIG. 3( c), three image signals 15, 16, 17 are overlapped toform an image superposed signal 18. In this situation, the thresholdmethod is ineffective but the profile detection method still canrecognize each mean position. If three point light sources almostapproach the image overlapped line as shown in FIGS. 3( d) and 3(e), themean position no longer can be identified. In this situation, the meanposition of each point light source can be treated as equivalent but themeasurement error more or less is not avoidable. If let the lightemitting radius r of the point light source can be very small but theemitting light still has sufficient intensity to form an image, then thestandard deviation c of the image signals I(x) can be as small as oreven smaller than the width of a signal pixel on the linear sensor array12, such that the mentioned measurement error can be reduced and theimage overlapped phenomenon is overcame.

(2) Geometric Modulation Method

With reference to FIGS. 3( f) to 3(i) for schematic views of thegeometric modulation method, the image signals 15, 16, 17 on the linearsensor array formed by three point light sources with the same I₀ butdifferent σ₁, σ₂, σ₃ are I₁(x), I₂(x), I₃(x) respectively, and the imagesuperposed signal 18 is I(x) as listed below:

$\begin{matrix}{{I_{1}(x)}I_{0}^{- \frac{{({x - \mu_{1}})}^{2}}{2\sigma_{1}^{2}}}} & (2) \\{{I_{2}(x)} = {I_{0}^{- \frac{{({x - \mu_{2}})}^{2}}{2\sigma_{2}^{2}}}}} & (3) \\{{I_{3}(x)} = {I_{0}^{- \frac{{({x - \mu_{3}})}^{2}}{2\sigma_{3}^{2}}}}} & (4) \\{{I(x)} = {{I_{1}(x)} + {I_{2}(x)} + {I_{3}(x)}}} & (5)\end{matrix}$

Where, σ₁, σ₂, σ₃ are known and σ₃>σ₂>σ₁.

In FIG. 3( f), three point light sources are all aligned on the imageoverlapped line at the same time, such that the image signals arecompletely overlapped. In FIGS. 3( g) and 3(h), three point lightsources are very close to the image overlapped line, such that the imagesignals are much intensively overlapped. In FIG. 3( i), three pointlight sources are close to the image overlapped line, such that theimage signals are less intensively overlapped. When an image overlappedphenomenon occurs, it becomes a technical subject for the geometricmodulation to solve μ₁, μ₂, μ₃ by the measured image superposed signals18 I(x).

In FIG. 3( j), a method of deduction and a Gaussian Fitting are used tofind μ₁, μ₂, μ₃. The method of deduction refers to a method ofseparating each image signals in the image superposed signals 18 in asequence from the largest point light source to the smallest point lightsource. In other words, a portion of I₃(x) found in I(x) is transformedby Gaussian Fitting to obtain I₃(x) and μ₃, and then I₃(x) is subtractedand separated from I(x), such that I′(x)=I(x)−I₃(x) is obtained.Similarly, I₂(x) is separated from I′(x) to obtain I₁(x) by suing thesame architecture. The advantage of the geometric modulation is that thecalculation is not affected by the image overlapped phenomenon and canobtain the mean position μ of each image signals formed by all pointlight sources. The drawback of the geometric modulation is that itrequires more mathematical calculations, and the size of each pointlight source must be divided clearly.

Improvement of Time Modulation Method

As described in Stephenson's patent, Stephenson used a diode to monitorthe lighting timing of a plurality of point light sources, so as toachieve the purpose of synchronously scanning the linear sensor arrayand improve the Reymond wire method. The lighting timing of each signalis shown in FIG. 4( a), which illustrates Stephenson's time modulationmethod. FIG. 4( a) shows the synchronous timing between the lighting ofa plurality of point light sources and the scanning and reading of thelinear sensor array. Emitters 1 to 3 (which are point light sources) arelit by a fixed cycle continuously and alternately. After the diodereceives these optical signals, a synchronous signal SYNC is generatedto synchronously drive all linear sensor arrays to start scanning.

FIG. 4( b) shows the sheltery problem occurred in the actual gestureoperation when the point light sources are installed onto a hand orfingers. Due to the free movement of the hand or fingers, one of thepoint light sources, for example emitter 2, may be sheltered by the handanytime, and thus causing asynchronous problem which results in a wrongdata acquisition scanned by the linear sensor array. Stephenson patenthas not provided any solution to this problem. For the asynchronousproblem, the present invention provides the following two methods forsolving the problem.

(3) Improvement of Stephenson's Method

FIG. 4( c) shows the schematic view of the improvement of Stephenson'stime modulation method. As to the light sources emitted by theEmitter1˜Emitter3, a microprocessor(μ P) is used to receive the signalprovided by the Diode at a proper time(for instance, before theoperation or at a constant time interval during the operation) and thusmeasure the period of continuous and alternate lighting timing ofEmitter1˜Emitter3, and synchronously generate a synchronous signal SYNCwith the same period, so as to overcome the asynchronous problem.

(4)Master/Client Wireless Synchronization Method

Unlike the methods provided by Reymond and Stephenson, the master/clientwireless synchronization method is a radio-frequency (RF) method foremitting a synchronous signal with a code from a transmitter (master),and the coded synchronous signal includes a number of a point lightsource to be lit and a timing signal required for the lighting of thepoint light source. After the receiver (client) receives the codedsynchronous signal, the information in the coded synchronous signal canbe decoded for a correct synchronization control to achieve the timemodulation effect.

In FIG. 4( d) shows the schematic view of the Master/Client WirelessSynchronization Method. The RF transmitter 21 installed at the site oflinear positioning sensor 20 emits a coded RF synchronous signal 22. Thecoded synchronous signal 22 includes an encoding signal 24 and asynchronous signal 25. The encoding signal 24 represents the number of apoint light source to be lit, and the synchronous signal 25 representsthe timing of a point light source to be lit. The encoding signal 24 canbe composed of a group of binary codes, a square wave with specific timeduration, or a specific number of pulses. After the RF receiver 26installed at a hand receives the coded RF synchronous signal 22, thecoded synchronous signal 22 is outputted to a decoder 27. The decoder 27can separate the encoding signal 24 and the synchronous signal 25, andthen output the two signals to a point light source switch 28. Theswitch 28 will light each point light source 29 according to the numberof the point light source at the correct time. Regardless of the pointlight source being sheltered or not, the number and timing of the litpoint light source are known on the site of the linear positioningsensor 20, so as to overcome the sheltering problem of the Stephenson'spatent. In addition, by using this encoding method, the point lightsources 29 can be lit at any timing and in any sequence. Of course, theRF transmitter can be installed at the hand, and the RF receiver can beinstalled at the site of linear positioning sensor to achieve the sameeffect. In a general RF technology, a modulation in the transmitter isusually needed, and a demodulation in a receiver is usually required.Such arrangement is a prior art, and thus will not be discussed ordescribed here.

In FIG. 4( e), the RF transmitter can emit another RF synchronous signal22 with a different code, and the purpose of encoding is to light allpoint light sources at the same time. Therefore, the aforementionedmethods of the intensity modulation, the geometric modulation and thewavelength modulation can be integrated with the master/client wirelesssynchronization method for increasing the variety of the uniquecharacteristics of the point light sources, so as to achieve a betterperformance.

(5) Wavelength Modulation Method

As the description in Schuiz's patent, although a concept of wavelengthmodulation method to overcome the image overlapped phenomenon has evermotioned, no further discussion and physical implementations have beenprovided. FIG. 5( a) to FIG. 5( c) shows the currently popular imagesensing art. FIG. 5( a) is the light emission spectrum of a general CCDor CMOS optical sensor array (refer to SONY/CCD/ILX526A). The sensiblewavelength usually ranges from 400 nm to 1000 nm and the width of asingle pixel ranges from few μm to few tens of μm. FIG. 5( b) shows thetransmission spectrum of a RGB color filter which is installed on thesurface of a CCD or CMOS optical sensor array (refer toSONY/CCD/ILX516K) and used to achieve the color imaging purpose byutilizing the optical wave filtering effect. FIG. 5( c) is thearrangement of a RGB color filter attached to the RGB pixels of a CCD orCMOS optical sensor array. By taking the advantage of current imagesensing technology, a wavelength modulation method is provided toovercome the image overlapped phenomenon and described as follow.

FIGS. 5( d) and 5(e) shows the schematic view of the wavelengthmodulation method. As to the image overlapped phenomenon caused by themultiple point light sources, the wavelength modulation method caneffectively solve the overlapped problem when the number of the pointlight sources is limited (for example, less than four). The basicprinciple of this method is to use multiple point light sources foremitting light sources with different wavelengths, and use differentcolor filters to filter and separate those multiple point light sources,and let the multiple point light sources each form an image onto adifferent pixel position of a 1D image sensor array or individually forman image onto different 1D image sensor arrays at the same time.

FIG. 5( d) shows the schematic view of three point light sources withdifferent wavelengths. As to Emitter1˜Emitter3 installed on a hand orfingers, Emitter1˜Emitter3 can be white light LED or color LED withproper wavelength, or semiconductor laser diode. After the light sourcesemitted by Emitter1˜Emitter3 are filtered each by a proper opticalbandpass filter, three light sources having different wavelengthsλ₁±Δλ₁, λ₂±λ₂ and λ₃±Δλ₃ are emitted, wherein λ₁, λ₂ and λ₃ are thecentral wavelength of the optical bandpass filter and 2Δλ₁, 2Δλ₂ and2Δλ₃ are the FWHM(Full Width at Half Maximum). The selection of thecentral wavelength and FWHM is based on the transmission spectrum of theRGB color filters. As to the transmission spectrum shown in the FIG. 5(b), the central wavelength and FWHM can be set as λ₁

450 nm (blue light), λ₂

550 nm (green light), λ₃

630 nm (red light), 2Δλ₁

20 nm, 2Δλ₂

20 nm and 2Δλ₃

20 nm. Generally, the RGB color filters are not effective for thefiltering function and fail to overcome the image overlapped phenomenonif the value of Δλ₁′ Δλ₂′ Δλ₃ is too large. In addition, it is nonecessary to select λ₁′ λ₂′ λ₃ in the visible light spectrum but in theinfrared spectrum if the proper infrared light sources and infraredbandpass filters are used.

FIG. 5( e) shows the arrangement of RGB color filters on a 1D opticalsensor array. As to a 1D optical sensor array 12, the RGB color filters,based on an unit of pixel, can be alternately arranged in a sequence ofR′ G′ B. Therefore, the alternately arranged RGB color filters canseparate the mentioned three point light sources with λ₁

450 nm (blue light), λ₂

550 nm (green light) and λ₃

630 nm (red light) and individually form an image onto the R′ G′ B pixel(only red light used for illustrating the optical separating and imageforming effect in the figure). The advantage of this method is toprocess three formed images at the same time by using one 1D opticalsensor array only and the drawback is the measurable spatial resolutionof the point light source is reduced to one third.

In order to improve the spatial resolution, as shown by FIG. 5( f), a 1Dthree color optical sensor array (refer to SONY/CCD/ILX516K) is used. Asto three point light sources with λ₁

450 nm (blue light), λ₂

550 nm (green light) and λ₃

630 nm (red light), three RGB color filters with different filteringwavelength are individually attached to three 1D optical sensor arrays,so as to achieve the purpose of wavelength modulation.

In addition, the currently existing 2D color CCD or CMOS optical sensorsarray has been produced massively and used by the digital cameras. Whenconsidering the cost, the current 2D color CCD or CMOS optical sensorsarray can replace the 1D CCD or CMOS optical sensors array. Taking theadvantage of massive production of 2D color CCD or CMOS optical sensorsarray but changing the arrangement of color filters and the scanningprocess of image, 2D color CCD or CMOS optical sensors array can be usedto achieve the purpose of wavelength modulation also. FIG. 5( g) showsthe arrangement of RGB color filters in a 2D color CCD or CMOS opticalsensors array. The RGB color filters, based on an unit of row, arealternately arranged in a sequence of R′ G′ B. FIG. 5( h) shows anotherarrangement of RGB color filters. In addition, a scanning process of a2D color CCD or CMOS optical sensors array is shown by FIG. 5( i). Byutilizing a microprocessor (μP), a row decoder and a column decoder, ascanning process can read any pixel #ij (that is ith row and jth column)directly to achieve the purpose of random access.

2. Process of Background Light

In the aforementioned US patents, only Reymond and Schuiz describe theprocess of measured data which is limited to the elimination ofbackground light. As the description above, the process utilizes ahardware or a software method to achieve the effect of background lightelimination by a process of threshold comparison. Generally, thecondition required by the process of threshold comparison is that thebackground light must be a constant DC value which is independent oftime. However, this method is ineffective if the background light varyin the space and time frame. In addition, as for the further process ofmeasured data regarding the background light interference, there is nodiscussion in both Reymond's and Schuiz's patents.

Elimination of Dynamic Background Light

As to a regular indoor environment, the background light usually comesfrom the fluorescent lamp and Halogen lamp (or a tungsten lamp). FIG. 6(a) and FIG. 6( b) show the light emission spectrum both of fluorescentand Halogen lamp. Basically, these light sources cause problems such asthe unstable, overlap and saturation phenomenon to the image signalsensed by the optical sensor array. Therefore, a term of ambient lightinterference phenomena is given to represent these phenomena. Thephenomena produce an ambient light interference noise on the opticalsensor array. As to the ambient light interference noise, the method ofthreshold comparison is completely ineffective and fails to obtain thecorrect image signals. Methods of eliminating the ambient lightinterference noise are given and described as follow.

At the time t_(k), the image signal I(x,t_(k)) produced by the 1Doptical sensor array is a superposed signal composed of an image signals(x,t_(k)) formed by the point light sources and an ambient lightinterference noise N(x,t_(k)). The relation can be described asfollowing equations.

$\begin{matrix}{{I( {x,t_{k}} )} = {{S( {x,t_{k}} )} + {N( {x,t_{k}} )}}} & (6) \\{{S( {x,t_{k}} )} = {\sum\limits_{m = 0}^{M - 1}{S( {x_{m},t_{k}} )}}} & (7) \\{{N( {x,t_{k}} )} = {\sum\limits_{m = 0}^{M - 1}{N( {x_{m},t_{k}} )}}} & (8)\end{matrix}$

Where, S(x,t_(k)) is the effective image signal formed by a plurality ofpoint light sources, M is the total number of pixel on 1D optical sensorarray and may have a value of 2 ^(a) (for example, a=10,M=2¹⁰=1024), andx_(m) is the position of mth pixel on the sensor.

In general, the ambient light interference noise N(x,t_(k)) mostly comesfrom the ambient light sources and the reflecting light sources of theambient light produced by other objects, and partially is generated bythe dark current of the optical sensor and the electric noise producedby the circuit. In addition, because of the phenomenon, such as (1) theintensity of the ambient light source is not a constant value but has anAC feature because of the use of AC power source, (2) the users mayadjust the intensity of the ambient light source and even turn on andoff the ambient light source at any time, (3) the movement of user'sbody may directly interfere the ambient light source if the ambientlight source is disposed at a position with the same height as theoptical sensor and a position in the back position of the user, in thetime frame, the ambient light interference noise N(x,t_(k)) is not aconstant value but a time dependent function. Especially interferencecaused by (3) deteriorates the stability of N(x,t_(k)). These are thereasons why the threshold comparison method is ineffective. Therefore,the signals generated by such phenomenon refer to as the time dependentambient light interference signal.

In addition, the lamp and its lampshade may have a specific geometricstructure and objects with high reflectivity (such as mirror and metalbutton on the clothing) exist in the space such that these light sourceswith specific geometric structures may form an image signal, beingtransformed by a 1D optical lens, which is similar with the effectiveimage formed by the point light source, and the worse is that theinterference signal is overlapped with the effective image signaldirectly. This phenomenon is also another reason that causes thethreshold comparison method ineffective. Therefore, the signalsgenerated by such phenomenon refer to as the space dependent ambientlight interference signal. Hereinafter, both time and space dependentambient light refers to as the dynamic background light and its imagesignal refers to as dynamic background light signal.

A real time elimination method of time dependent ambient lightinterference signal and a method of Fourier signal process (that is theelimination method of space dependent ambient light interference signal)being disclosed hereinafter, further cooperating with a thresholdcomparison method and/or a profile detection method, can effectivelysolve the problem of dynamic background light interference and obtainthe effective image signal. Hereinafter, both the real time eliminationmethod of time dependent ambient light interference signal and themethod of Fourier signal process refer to as the elimination method ofdynamic background light signal.

Elimination Method of Time Dependent Ambient Light Interference Signal

Since the optical sensor array has a characteristic of linearsuperposition and the 1D lens has a characteristic of forming lineimage, by taking the advantage of using one more 1D optical sensor array13, as shown in FIG. 5( j) and FIG. 5( k), the dynamic background lightsignal N′(x,t_(k)) can be obtained at the same time, then subtractN′(x,t_(k)) from I(x,t_(k)) in equation (6) to obtain:

I′(x,t _(k))=I(x,t _(k))−N′(x,t _(k))   (9)

Substitute equation (6) into equation (9) and obtain:

I′(x,t _(k))=S(x,t _(k))+ΔN(x,t _(k))   (10)

Wherein,

ΔN(x,t _(k))=N(x,t _(k))−N′(x,t _(k))   (11)

Herein, by a hardware method, the signal N′(x_(m),t_(k)) is obtained byusing another 1D optical sensor array 13. Hereinafter, the 1D opticalsensor array 13 refers to as the noise measurement 1D optical sensorarray while the 1D optical sensor array 12 refers to as the signalmeasurement 1D optical sensor array. As for the noise measurement 1Doptical sensor array 13, a proper optical filter (not shown in thefigure) must be attached and used to block out the point light sourcesbut transmit the ambient light sources, and its arrangement must be asclose as to and parallel to the signal measurement 1D optical sensorarray 12. In addition, the scanning and reading process of the noisemeasurement 1D optical sensor array 13 is synchronous with the scanningand reading process of the signal measurement 1D optical sensor array12. Also, an electrical amplifier installed in the scanning and readingcircuit is used to amplify the dynamic background light signal to aproper magnitude for obtaining following equation:

ΔN(x,t _(k))=DC+δn(x,t _(k))   (12)

Such that equation (10) become:

I′(x,t _(k))

S(x,t _(k))+δn(x,t _(k))+DC   (13)

Wherein, DC is a direct current approximated signal having low frequencycharacteristics and δn(x,t_(k)) is treated as a space dependent ambientlight interference signal having high frequency characteristics. Inaddition, the following condition can be achieved by increasing thepower of the point light sources properly.

δn(x,t_(k))

S(x,t_(k))   (14)

A threshold comparison method is then applied to obtain the effectiveimage signal S(x,t_(k)). The so called threshold comparison method is amethod that determines a proper value greater than the valueDC+δn(x,t_(k)) in equation (13), so as to obtain the effective imagesignal S(x,t_(k)) by utilizing a comparison method. In addition, as forthe point light sources adopting the intensity modulation method, aprofile detection method is more effective to obtain the effective imagesignal S(x,t_(k)). The so called profile detection method is a methodthat utilizes the characteristics of the image signal waveform to obtainthe effective image signal S(x,t_(t) _(k)). When comparing withbackground light sources, since the emitting power per unit area of thepoint light source used in the present invention is much larger than thebackground light sources and the emitting size is much smaller than thebackground light sources, the waveform of the image signal has acharacteristic of sharp peak. In present invention, the standarddeviation σ of the image signal is a relative small value, such as 20˜30μm, and the central intensity I₀ is a relative large value, and theslope of the image signal waveform is also a relative large value whencomparing with the background light sources. Therefore, the standarddeviation σ, the central intensity I₀ and the slope of the waveform canbe used to obtain the effective image signal S(x,t_(k)).

Generally, since the electric power used by the point light sources isprovided by a regular battery, as the above description, the S/N ratiocan be increased by increasing the emitting power of the point lightsources, such that results in the increase of power consumption and thereduction of the battery's life time. Under a condition withoutincreasing the emitting power, a signal processing method must be usedto reduce ΔN(x,t_(k)), so as to achieve the purpose of obtaining higherS/N ration.

(2)Elimination Method of Space Dependent Ambient Light InterferenceSignal(Method of Fourier Signal Process)

The well known Fourier Optics is used to eliminate the useless geometricstructures or noises in the spatial domain, so as to obtain the valuablegeometric structures. The basic principle of Fourier's process is toremove those frequencies characterized by the useless geometricstructures or noises in the frequency domain, so as to achieve thepurpose of Fourier Optics. Therefore, technique of Fourier Optics can beused to reduce ΔN(x,t_(k)), so as to achieve the purpose of obtaininghigher S/N ration. Apply a Fourier transformation to equation (10) andobtain:

$\begin{matrix}{{{I^{\prime}( {\omega_{n},t_{k}} )} = {{S( {\omega_{n},t_{k}} )} + {\Delta \; {N( {\omega_{n},t_{k}} )}}}}{{Wherein},}} & (15) \\{{S( {\omega_{n},t_{k}} )} = {\sum\limits_{m = 0}^{M - 1}{{S( {x_{m},t_{k}} )}^{{- j}\frac{2\pi}{M}{mn}}}}} & (16) \\{{\Delta \; {N( {\omega_{n},t_{k}} )}} = {{\sum\limits_{m = 0}^{M - 1}{\Delta \; {N( {x_{m},t_{k}} )}^{{- j}\frac{2\pi}{M}{mn}}}} = {\sum\limits_{m = 0}^{M - 1}{\lbrack {{DC} + {\delta \; {n( {x_{m},t_{k}} )}}} \rbrack ^{{- j}\frac{2\pi}{M}{mn}}}}}} & (17)\end{matrix}$

As the aforementioned Fourier's method, a bandpass filtering functionBPF(ω_(n)) is used to reduce the low frequencies generated by DC signaland the high frequencies generated by δ_(n)(x,t_(k)) signal in thefrequency domain, and an inverse Fourier transform is then applied toobtain a clean and approximative image signal of the point lightsources. Therefore, apply a bandpass filtering and inverse Fouriertransforming operations to equation (15) and obtain:

$\begin{matrix}{{I^{\prime}( {x_{m},t_{k}} )} = {\sum\limits_{n = 0}^{M - 1}{^{j\frac{2\pi}{M}{mn}}\{ {\lbrack {{S( {\omega_{n},t_{k}} )} + {\Delta \; {N( {\omega_{n},t_{k}} )}}} \rbrack \times B\; P\; {F( \omega_{n} )}} \}}}} & (18)\end{matrix}$

Equation (18) is simplified as follow:

I′(x _(m) ,t _(k))=S′(x _(m) ,t _(k))+δ′n(x _(m) ,t _(k)  (19)

Wherein,

$\begin{matrix}{{S^{\prime}( {x_{m},t_{k}} )} = {\sum\limits_{n = 0}^{M - 1}{^{j\frac{2\pi}{M}{mn}}\{ {{S( {\omega_{n},t_{k}} )} \times B\; P\; {F( \omega_{n} )}} \}}}} & (20) \\{{\delta^{\prime}{n( {x_{m},t_{k}} )}} = {\sum\limits_{n = 0}^{M - 1}{^{j\frac{2\pi}{M}{mn}}\{ {\Delta \; {N( {\omega_{n},t_{k}} )} \times B\; P\; {F( \omega_{n} )}} \}}}} & (21)\end{matrix}$

While the bandpass filtering function is:

$\begin{matrix}{{B\; P\; {F( \omega_{n} )}} = \{ \begin{matrix}0 & {{{when}\mspace{14mu} \omega_{n}} < \omega_{L}} \\A & {{{when}\mspace{14mu} \omega_{L}} \leq \omega_{n} \leq \omega_{H}} \\0 & {{{when}\mspace{14mu} \omega_{H}} < \omega_{n}}\end{matrix} } & (22)\end{matrix}$

In other words, in the frequency domain, the coefficients of frequencieslower than ω_(L) and the coefficients of frequencies higher than ω_(H)are removed, namely most of the characteristic frequencies ofΔN(ω_(n),t_(k)) are removed, while the rest of coefficients aremultiplied by a real value A. The image signal S′(x_(m),t_(k)) can bemagnified if A>1.0, so as to obtain δ′n(x_(m),t_(k))

S′(x_(m),t_(k)) or a higher S/N ratio, and then obtain the followingresult:

I′(x_(m),t_(k))

S′(x_(m),t_(k))   (23)

Finally, the threshold comparison and/or the profile detection methodare used to obtain the effective image signal S(x,t_(k)). As theaforementioned dynamic background light signal elimination method, themethod mainly uses another noise measurement 1D optical sensor array toobtain the dynamic background light signal. Unfortunately, this methodwill increase the hardware's cost and complexity. A software method,referred to as the approximated real time elimination method of timedependent ambient light interference signal, is disclosed as follow.

(3) Approximated Real Time Elimination Method of Time Dependent AmbientLight Interference Signal

The so called approximated real time elimination method of timedependent ambient light interference signal is a method that uses asoftware method, instead of using a noise measurement 1D optical sensorarray, to achieve the purpose of reducing the time dependent ambientlight interference signal. According to the above description, as forthe time dependent ambient light interference, the background lightsignal may deform and waggle severely when the user's body interfere thelight source of lamp directly, such that a correct image signal of thepoint light sources is hardly obtained. When comparing the scanning rateof a 1D optical sensor array (for instance, 10⁻³ sec/scan), the movingspeed of a user's body is relative slow. For two consecutively scannedimage signals I(x,t_(k)) and I(x,t_(k-1)), expressed as follow:

I(x,t _(k))=S(x,t _(k))+N(x,t _(k))   (24)

I(x,t _(k))=S(x,t _(k))+N(x,t _(k-1))   (25)

The variation of the dynamic background light signal N(x,t_(k)) andN(x,t_(k-1)) at the time Δt=t_(k)−t_(k-1) can be treated as a relativesmall magnitude when comparing with the image signal S(x,t_(k)).Therefore, subtract equation (25) from equation (24) and obtain:

$\begin{matrix}{{I^{\prime}( {x,t_{k}} )} = {{{I( {x,t_{k}} )} - {I( {x,t_{k - 1}} )}} = {{\Delta \; {S( {x,t_{k}} )}} + {\Delta \; {N( {x,t_{k}} )}}}}} & (26) \\{{\Delta \; {S( {x,t_{k}} )}} = {{S( {x,t_{k}} )} - {S( {x,t_{k - 1}} )}}} & (27) \\{{{\Delta \; {N( {x,t_{k}} )}} = {{N( {x,t_{k}} )} - {N( {x,t_{k - 1}} )}}}{{Wherein},}} & (28) \\{{\Delta \; {S( {x,t_{k}} )}} = \{ \begin{matrix}{{{G( \mu_{k} )} - {G( \mu_{k - 1} )}},} & {{when}\mspace{14mu} {point}\mspace{14mu} {light}\mspace{14mu} {sources}\mspace{14mu} {are}\mspace{14mu} {in}\mspace{14mu} {moving}\mspace{14mu} {status}} \\{0,} & {{when}\mspace{14mu} {point}\mspace{14mu} {light}\mspace{14mu} {sources}\mspace{14mu} {are}\mspace{14mu} {in}\mspace{14mu} {static}\mspace{14mu} {status}}\end{matrix} } & (29) \\{{\Delta \; {N( {x,t_{k}} )}} = {{{N( {x,t_{k}} )} - {N( {x,t_{k - 1}} )}} = {\delta \; {n( {x,t_{k}} )}}}} & (30)\end{matrix}$

In the approximated real time elimination method of time dependentambient light interference signal, equation (29) and (30) describe thefeatures of both the image signal and the dynamic background lightsignal. The image signal is presented by the subtraction of two Gaussiansignal G(μ_(k)) and G(μ_(k-1)) at two different position when the pointlight sources are in the moving status, while the image signal becomeszero when the point light sources are in the static status. In addition,signal δn(x,t_(k)) contained in the dynamic background light signal hasthe same feature with equation (12). Therefore, the aforementionedmethod of Fourier signal process can be used to eliminate the spacedependent ambient light interference signal. In case of the staticstatus, since the image signal is zero, the original image signal is noway to be retrieved when equation (29) is processed by the Fouriersignal process. In order to solve this problem, a tracking method can beused to predict the current position of point light sources by referringto the previously measured position data.

3. Data Process (Calculation of Spatial Resolution and Mean Position)

With reference to FIG. 7( a) for the schematic view of an optical systemadopted by Reymond, three linear sensor arrays S₁ S₂ S₃ are installed ina world coordinate system O(X,Y,Z), and their centers are disposed at(−h,0,0), (0,0,0), (h,0,0), and the direction of their long axis areshown in the figure. Further, three 1D lenses L₁ L₂ L₃ with equal focallength f are installed, and their optical axis directions are Z₁ Z₂ Z₃respectively, and their focusing directions are shown in the figure. Fora point light source o(x₁,y₁,z₁), the image mean position on S₁ S₂ S₃are y_(s1) y_(s2) y_(s3) respectively. In addition, the visual axis ofthis optical system is Z axis of the world coordinate system O(X,Y,Z).Therefore, the spatial position of the point light source o(x₁,y₁,z₁)can be calculated by the following positioning calculation equation(Refer to the aforementioned three R.O.C. patents for the details of thecalculation).

$\begin{matrix}{{x_{1} = {\frac{y_{s\; 1} + y_{s\; 3}}{y_{s\; 1} - y_{s\; 3}}h}};} & (31) \\{y_{1} = {{- \frac{2h}{y_{s\; 1} - y_{s\; 3}}}y_{s\; 2}}} & (32) \\{z_{1} = {( {1 + \frac{2h}{y_{s\; 1} - y_{s\; 3}}} )f}} & (33)\end{matrix}$

Where f, h are known, and y_(s1), y_(s2), y_(s3) are measured values.

As to the positioning error of the optical system, the error can beevaluated by the following equations.

$\begin{matrix}{{\Delta \; x_{1}} = {\frac{( {z_{1} - f} )}{f}\Delta \; y_{s\; 1}}} & (34) \\{{\Delta \; y_{1}} = {{- \frac{( {z_{1} - f} )}{f}}\Delta \; y_{s\; 2}}} & (35) \\{{\Delta \; z_{1}} = {{- \frac{( {z_{1} - f} )^{2}}{hf}}\Delta \; y_{s\; 1}}} & (36)\end{matrix}$

Equations (34) to (36) clearly show that the errors Δx₁ Δy₁ Δz₁ of thepositions of the point light source in each direction are determined bythe optical parameters f h, longitudinal distance z₁, and measurederrors Δy_(s1) Δy_(s2) Δy_(s3). Therefore, the Δx₁ Δy₁ Δz₁ obtained fromthe smallest Δy_(s1) Δy₂ Δy_(s3) are defined as the spatial resolutionsof the optical system.

From the description above, under a condition of no dynamic backgroundlight interference, after a point light source is transformed through a1D optical lens onto a linear sensor array, the effective imageintensity I(x) is close to a Gaussian distribution as shown in Equation(1). Since the linear sensor array is composed of a row of discretephotosensitive pixels with a width and a gap as shown in FIG. 3( a), andthe actual measured image signal I(x) becomes:

$\begin{matrix}{{I(x)} = {\sum\limits_{i}{{\overset{\_}{I}( x_{i} )}\Delta \; w}}} & (37)\end{matrix}$

Where, Ī(x_(i)) is the measured mean value per unit length of the i^(th)pixel which depends on several physical parameters such as the pixelsize, photosensitivity, intensity and wavelength of incident light andambient temperature, and Δw is the mean width of a pixel. If a positionx_(i) of the maximum Ī(x_(i)) (which is the position of the brightestsensed pixel) is obtained and used as a measured value of y_(s1) y_(s2)y_(s3), then the minimum measuring error Δy_(s1) Δy_(s2) Δy_(s3) is thewidth Δw of the single pixel. An example is used for illustrating theevaluation of a spatial resolution as follows.

Assumed that each parameter is known as follows:

f=20 mm h=200 mm Z₁=2000 mm

Δy_(s1)Δy_(s2)=Δy_(s3)=Δw

5 μm

Substitute the foregoing parameters into Equations (34) to (36) toobtain

Δx₁

0.5 mm, Δy₁

0.5 mm, Δz₁

5 mm

If the position of the brightest sensed pixel is used as an image meanposition, then the width Δw of the pixel determines the spatialresolution. In FIG. 7( b) shows the change of image signal when Δw=5 μmand the displacement of the point light source is 0.5 μm. The upperfigure shows an image signal before moving, and the lower figure showsan image signal after moving. If the displacement of the point lightsource is smaller than the width Δw of a pixel, the position of thebrightest sensed pixel may remain unchanged, and thus will not changethe positioning calculation result. As to the tiny variation of theimage signal in between the pixels, it is necessary to use the GaussianFitting or the following statistical calculation equation for obtainingthe mean position μ.

$\begin{matrix}{\mu = \frac{\sum\limits_{i = 1}^{M}{x_{i}{\overset{\_}{I}( x_{i} )}}}{\sum\limits_{i = 1}^{M}{\overset{\_}{I}( x_{i} )}}} & (38)\end{matrix}$

Where, N is the total number of sensed pixels of the linear sensorarray, and Ī(x_(i)) is the measured value of the I^(th) sensed pixel. Ingeneral, a digital value is obtained, after an analog-to-digitalconverter (ADC) converts the analog voltage value Ī(x_(i)) of the sensedpixel, If a 10-bit ADC is used, the inputted analog voltage value canrecognize 1024-level tiny variation easily. Therefore, theaforementioned two methods of calculating the average position μ canimprove the resolution of the 3D position measurement up to the order ofmicron (μm). Further, if the distance of z₁ is reduced to a relativesmall value, the resolution can be improved up to the order ofnanometer(nm). Thus, the present invention can be applied forpositioning a non-contact precision measurement instrument.

4. Extension of System Configurations (Blind Spot Compensation, ViewingAngle Expansion, and Visual Axis Tracking)

As known, any optical system has the issues of blind spots and limitedviewing angle. The 1D optical positioning system also has these issues.In view of domestic and foreign patents, no solution of these issues hasbeen given. In FIG. 8( a), the maximum viewing angle 51 of the 1Doptical positioning system 50 limits the movable range of the pointlight source 52 (The present invention only uses the 1D or thehorizontal viewing angle as the example for illustration).

With reference to FIG. 8( b) for the solution of a blind spot, if thepoint light source 52 is sheltered by an obstacle 53 (such as user'sbody), one or more 1D optical positioning system 50′ can be installed atappropriate positions for compensating the blind spot problem.

With reference to FIG. 8( c) for a schematic view of a viewing angleexpansion method, one or more 1D optical positioning systems 50′ can beinstalled at appropriate positions in the space for expanding theviewing angle 51′.

With reference to FIG. 8( d) for a schematic view of a visual axistracking method, if the point light source 52′ move out of the originalrange of the viewing angle 51, the 1D optical positioning system 50 canpredict the movement of the point light source 50 and rotate its ownvisual axis 54 to an appropriate angle 54′, such that the point lightsource 52′ can move inside the new range of viewing angle 51′.

To achieve the purposes of a blind spot compensation, a viewing angleexpansion, and a visual axis tracking for overcoming the issues as shownin FIGS. 8( b) to 8(d), the 1D optical positioning system 50 as shown inFIG. 8( e) must have the function of rotating the visual axis and beingpositioned. The function of the rotating visual axis is performed by theknown prior art such as a rotating mechanism, a motor, and an angularmeasurement, and can rotate the visual axis 54 horizontally (which is arotation of an angle Θ with respect to the y-axis), and vertically(which is a rotation with respect to the x-axis, and rotated at an angleφ). The function of being positioned uses a plurality of point lightsources 55 (hereinafter referred to as pilot point light sources)installed on a mechanical casing of the 1D optical positioning system 50to achieve the mutual positioning purpose in between a plurality of 1Doptical positioning systems 50. In other words, if the blind spotcompensation and the viewing angle expansion are conducted or when it isnecessary to place a plurality of 1D optical positioning systems 50 atany position in the space, the positioning measurement of the pilotpoint light sources 55 can be utilized to achieve the purpose ofmeasuring the position and the visual axis angle of the plurality of 1Doptical positioning systems 50.

5. Extension of System Applications

(1) Applications of Virtual Input Device

In the present invention, the virtual input device adopts a devicesimulated input method to substitute a physical input device completelyor partially without using a physical mechanical device such as a mouse,a keyboard, a joystick, a remote control or a touch screen whenoperating a conventional computer, a PDA, a mobile phone, a game playeror a television. The following physical input devices are used forillustrating the virtual input method below.

With reference to FIG. 9( a) for a schematic view of a general mouseoperated on a displayed screen 60 (hereinafter referred to as a physicaloperating screen) under the Windows operating system environment, amouse 61 is moved, pressed, released, clicked or double clicked toachieve Windows operations. In addition, a graphic cursor 61′ is used onthe physical operating screen 60 to mark and align a correspondingposition of the mouse 61. As to the operation of mouse, a gesture inputmethod used for replacing mouse operations is disclosed by R.O.C. Pat.Application No.: 096116210. However, only a single point light source isused in the patent to simulate the mouse operation.

In the device simulated input method, a virtual input devicecorresponding to a physical input device is used to simulate andrecognize the operation of a hand or fingers required by a physicalinput device to achieve the virtual input effect. The method provides aprocedure of virtual operating screen correspondence, a procedure ofvirtual device geometric structure definition and operating fingerscorrespondence and a procedure of operating gestures definition andrecognition. A mouse having a left button, middle button, a right buttonand a roller operated by three fingers is used for illustrating anddescribing the device simulated input method, and then the similardescription will be given for other physical input devices later.

With reference to FIG. 9( b) for a schematic view of a mouse simulatedinput device, the following procedures are described.

Procedure of Virtual Operating Screen Correspondence

As to a physical operating screen 60 with an actual dimensions of L(Length)×H (Width), a virtual operating screen 60′ with dimensions L′×H′can be defined at any position in the space, and the virtual operatingscreen 60′ has a spatial corresponding relationship with the physicaloperating screen 60, and the relationship is a one-to-one andproportional relation. In other words, L′=m×L and H′=n×H, where m n arereal numbers greater than 1, equal to 1, or smaller than 1. Only if apoint light source on a finger is moved on the virtual operating screen60′, a one-to-one correspondence can be found on the physical operatingscreen 60. In addition, the virtual operating screen 60′ can be set inair, or any fixed surface (such as a desktop or a wall that facilitatesthe operation by fingers).

Procedure of Virtual Device Geometric Structure Definition and OperatingFingers Correspondence

The physical position, size and motion of the function keys on thevirtual device and the correspondence relation between and the fingersand the virtual function keys are defined. The defined physicalposition, size and motion of the virtual function keys are used todetermine the interaction between the fingers and the virtual functionkeys, namely to determine whether or not the fingers are pressed on thevirtual function keys for an input operation; and the correspondencerelation between the fingers and the virtual function keys correlatesthe operated function keys with the operating fingers. For example, anindex finger 62 of a right hand corresponds to a left button 62′, and amiddle finger 63 of a right hand corresponds to a middle button and aroller 63′, and a ring finger 64 of a right hand corresponds to a rightbutton 64′. In an actual operation of the virtual input, a user's handis equivalent to hold a virtual mouse with substantially the samephysical structure and size of a real mouse, and operate the virtualmouse on a virtual operating screen 60′. In addition, the correspondencerelation between the fingers and the virtual function keys varies withthe user's operating habit. The correspondence relation can beone-to-many correspondence relation, such that a single finger can beused to operate a plurality of function keys.

Procedure of Operating Gestures Definition and Recognition

According to the description in R.O.C. Pat. Application No.: 096116210,the basic principle, when using a device simulated input method tosimulate the operating gestures such as moving, pressing, releasing,clicking or double clicking a mouse, is to utilize a plurality ofconsecutive gesture units to respectively define the operating gestureof a index finger, middle finger and ring finger. Each single gestureunit is composed of three consecutive physical states such as atemporary hold state, a specific movement state, and a temporary holdstate. For instance, the gesture of pressing left button by a indexfinger 62 can be defined as three consecutive physical states whichcomprise a temporary hold state, a downward short straight-line movementstate, and a temporary hold state, and the gesture of releasing leftbutton by a index finger 62 can be composed of a temporary hold state, aupward short straight-line movement state, and a temporary hold state,and the gesture of clicking left button by a index finger 62 can becomposed of two consecutive gestures such as a pressing gesture and areleasing gesture, and the gesture of double clicking left button by aindex finger 62 can be composed of two consecutive clicking gesture. Asto the middle and right button, the gesture definition is same as theleft button. As for gesture definition of roller, the consecutivephysical states of the middle finger 63 comprise a temporary hold state,a forward or backward short straight-line movement state, and atemporary hold state. As for the position of cursor 61′, it can bedefined and corresponded to the group center coordinate(refer to thedescription below) of three fingers which are in a relatively staticstate. It is certain that the operating gestures of a mouse definedabove are available for the emulation of a regular 2D mouse and satisfyuser's operation habit. However, the definition of gestures can bedifferent and also defined by a general gesture according to thedescription in R.O.C. Pat. Application No.: 096116210.

With reference to FIG. 9( c) for a schematic view of a remote controlsimulated input device, since the operation of a remote control issimple, and generally adopts a single key operation with the use of asingle finger to do the operation similar to a mouse. As to the remotecontrol, the purpose of virtual input can be achieved simply byproviding a virtual operating screen 60′, defining the geometricstructure of the virtual device 75, corresponding a single finger 74 toall function keys, and displaying an assisted graphic image of a cursor74′ corresponding to the operating finger and a remote control 76 on thephysical operating screen 60. With the assistance of the correspondingcursor 74′, the finger 74 can be moved to any function key for pressingor releasing the key to achieve the virtual input effect of a remotecontrol. In addition, by taking the advantage of virtual realitytechnology, the geometric structure of the virtual device 75 can bevisually displayed as a virtual stereo image and the operating finger 74can directly operate the virtual geometric structure of the device 75.Further, the operating finger 74 can also be visualized virtually, so asto improve the convenience of operation by using the virtual finger tooperate the virtual geometric structure of the device 75.

With reference to FIG. 9( d) for a schematic view of a touch screensimulated input device, the operation of a general physical touch screenis very simple and use a single finger to do an operation on thephysical operating screen 60 which is similar to the operation of amouse. As to the touch screen simulated input device, the purpose ofvirtual input can be achieved simply by defining a virtual operatingscreen 60′ and using the single finger 74 to operate the physicaloperating screen 60 with the assistance of a cursor 74′ whichcorresponds to the operating finger. In addition, by taking theadvantage of virtual reality technology, the virtual operating screen60′ can be visually displayed as a virtual stereo image and theoperating finger 74 can directly operate the virtual operating screen60′. Further, the operating finger 74 can also be visualized virtually,so as to improve the convenience of operation by using the virtualfinger to operate the virtual operating screen 60′.

With reference to FIG. 9( e) for a schematic view of a keyboardsimulated input device, although a general keyboard comes with manypress keys, and multiple keys can be operated simultaneously, the devicesimulated input method is basically similar to the operation of a remotecontrol and simply requires a virtual operating screen 60′ for definingthe geometric structure of a virtual device 80, a correspondencerelationship which corresponds a plurality of (for instance three)single finger 74 to all function keys, and an assisted graphic image 85of a keyboard displayed on the physical operating screen 60. With theassistance of a plurality of cursors 74′, each of the cursors 74′corresponds to a operating finger 74, the finger 74 can be moved ontothe key for pressing or releasing operation, so as to achieve thevirtual input effect of a keyboard. In addition, the virtual operatingscreen 60′ can be defined on a fixed physical surface such as a desktop,and a printing matter (for example a piece of paper printed with thekeyboard) of a keyboard is placed on the physical surface, so that theassisted graphic image 85 is no longer needed, and users can operate theprinting matter in a similar way of operating a real keyboard to achievethe virtual keyboard input effect. In addition, by taking the advantageof virtual reality technology, the geometric structure of the virtualdevice 80 can be visually displayed as a virtual stereo image and theoperating fingers 74 can directly operate the virtual geometricstructure of the device 80. Further, the operating fingers 74 can alsobe visualized virtually, so as to improve the convenience of operationby using the virtual fingers to operate the virtual geometric structureof the device 80.

(2) Applications of Simulator

The applications of the virtual input are described above. The 1Doptical positioning device of the present invention is capable ofmeasuring the positions of a plurality of point light sources at a highcomputing speed, a high spatial resolution, and a low manufacturingcost. Further, the use of a plurality of 1D optical positioning devicesis able to expand the measuring scope of the point light sources andcompensate the blind spots. These characteristics can also be are usedin the area of the simulator as follows:

With an appropriate number and a fixed method, a plurality of pointlight sources (for instance, three) are installed to a physicalracket-shaped object (such as a tennis, badminton, table tennis racket),a physical rod-shaped object (such as a baseball or softball bat), aphysical stick-shaped object (such as a golf club, a hockey stick, apool stick, a spear or a sword), a physical glove-shaped object (such asa baseball, softball or boxing glove), a physical spherical object (suchas a baseball, softball, basketball, soccer, volleyball, or bowlingball), a physical toy (such as a toy gun), a physical remote control toy(such as a remote control car, remote control plane or remote controlhelicopter), a physical remote control (such as a remote control of ahome video game player). As to a plurality of point light sourcesinstalled on a physical object, the 1D optical positioning device of thepresent invention is capable of measuring the positions of those pointlight sources in real time, so as to obtain the trajectory and otherphysical quantity of the physical object. In addition, taking theadvantage of virtual reality technology, a virtual object is defined inthe virtual space and its motion is corresponded to the motion of thephysical object (such as a racket). In conformity with physical laws,the virtual object is able to interact with other virtual object(such asa ball) in a lively and natural way(such as striking the ball), so as toachieve the simulating purpose of sports, shooting, driving and flying.

With reference to FIG. 10 for a schematic view of a first preferredembodiment in the present invention, as for the unique characteristicsof the point light sources, a device 100 of the first preferredembodiment mainly adopts the intensity modulation method or geometricmodulation method to achieve the purpose of virtual input device andsimulator by measuring and analyzing the 3D motion of a plurality ofpoint light sources. The device 100 comprises a plurality of point lightsources with unique characteristics 110, a plurality of 1D opticalpositioning devices with a visual axis tracking function 130 and acontrol analysis procedure 190. In the plurality of point light sourceswith unique characteristics 110, each point light source 111simultaneously and continuously emits a spot-like scattering lightsource 112 with unique physical properties. In the plurality of 1Doptical positioning devices 130, each 1D optical positioning devices 131measures the 3D positions of all point light source 111 and output a setof physical quantities 150 after receiving a synchronization enablesignal 150 and simultaneously receiving all spot-like scattering lightsources 112. In addition, each 1D optical positioning devices 131 isequipped with the visual axis tracking and positioning function and isable to automatically track the central group coordinate of thatplurality of point light sources and the coordinate of any one of thatplurality of point light sources (refer to the description below), andoutput an angular direction 150 of its own visual axis, so as to achievethe visual axis tracking purpose, and is also able to receive an angulardirection of its own visual axis, so as to achieve the visual axispositioning purpose. The control analysis procedure 190, being asoftware procedure, is connected to control all 1D optical positioningdevices 131, and mainly output a synchronization enable signal 150 forsynchronously starting all 1D optical positioning devices 131 to do the3D position measurement, and also output a set of angular direction ofvisual axis 150 for setting the angular direction of visual axis of each1D optical positioning devices, so as to achieve the visual axispositioning purpose for all 1D optical positioning devices, and receiveall physical quantity and angular direction of visual axis 150 tosimulate an input function of a physical input device, so as to achievethe virtual input purpose, and also to simulate the motion of a physicalobject, so as to achieve the purpose of simulator.

With reference to FIG. 11( a) for a schematic view of a plurality ofpoint light sources with unique intensity characteristic, each pointlight source 111 of the plurality of point light sources with uniqueintensity 110 has the same light emitting radius but different lightemitting intensity. In other words, each point light source has a uniquecharacteristic of light intensity, and all point light sources emitlights continuously at the same time. For simplicity, each point lightsource has a unique serial number #k.

With reference to FIG. 11( b) for a schematic view of a plurality ofpoint light sources with unique geometric characteristic, each pointlight source 111 of the plurality of point light sources with uniquegeometric size 110 has a different light emitting radius but the samelight emitting intensity. In other words, each point light source hasunique geometric characteristic, and all point light sources emit lightscontinuously at the same time. For simplicity, each point light sourcehas a unique serial number #k.

With reference to FIG. 11( c) for a schematic view of an assembly with asingle point light source, the point light source 111 comprises a lightscattering component 113, a light emitting source 116, an electroniccontrol circuit 117, a battery 118, a point light source fixationmechanism 119, and a device fixation mechanism 120. The light scatteringcomponent 113 is an object that can uniformly scatter the incident lightalong all angular directions. The light emitting source 116 is composedof one or multiple LED or semiconductor laser diodes for emittingvisible light or non-visible light. The electronic control circuit 117including a power switch and a circuit of a constant current sourceprovides the function of a power switch and a constant current sourcewhich is supplied to the light emitting source 116 for obtaining aspecific and stable brightness of the emitted light. In addition, thepoint light source fixation mechanism 119 is a mechanical mechanism forinstalling and fixing the light scattering component 113, the lightemitting source 116, the electronic control circuit 117, and the battery118.

The device fixation mechanism 120 can fix the point light sourcefixation mechanism 119 on an object as shown in FIGS. 11( e) to 11(n).The object can be fingers of a hand, a forehead of a head, or an instepof a foot as shown in FIG. 11( e); a racket-shaped object such as atennis, badminton, table tennis racket as shown in FIG. 11( f); arod-shaped object such as a baseball or softball bat as shown in FIG.11( g); a stick-shaped object such as a golf club, a hockey stick, apool stick, a knife, a sword or a spear as shown in FIG. 11( h); aglove-shaped object such as a baseball, softball, or boxing glove asshown in FIG. 11( i); a spherical object such as a baseball, softball,basketball, soccer, volleyball or bowling ball as shown in FIG. 11( j);a toy such a toy gun as shown in FIG. 11( k); a remote control toy suchas a remote control car, a remote control plane or a remote controlhelicopter as shown in FIG. 11( l); a joystick as shown in FIG. 11( m);or a remote control of a home video game player as shown in FIG. 11( n).

With reference to FIG. 11( d) for a schematic view of a light scatteringcomponent, the light scattering component 113 is comprised of atransparent optical guide material 123 and a scattering material 124.The transparent optical guide material 123 can be any shape, preferablya spherical shape, and can be made of any transparent material,preferably a glass or a plastic material. The scattering material 124 isinstalled inside the transparent optical guide material 123 and the mostpreferred scattering material 124 is a randomly distributed powder withlight reflecting capability, or a randomly distributed transparentpowder, or a randomly distributed tiny air bubbles, or a smaller andtransparent ball. In addition, the optical index of the scatteringmaterial 124 is smaller than the optical index of the transparentoptical guide material 123. Further, a light incident window with propersize and shape disposed at an appropriate position on the transparentoptical guide material 123 allows the incident light emitted from thelight emitting source 116 to enter the transparent optical guidematerial 123 through a better angle.

With reference to FIG. 12( a) for a schematic view of a single 1Doptical positioning device with visual axis tracking function, thesingle 1D optical positioning device 131 with a visual axis trackingfunction comprises a plurality of linear positioning sensors 132, apositioning calculation control microprocessor 145, a signaltransmission interface 146, a group of pilot point light sources 160, a1D optical positioning device fixation mechanism 170, and a two-axisangular control device 180. For simplicity, the single 1D opticalpositioning device 131 has a unique serial number #i and the singlelinear positioning sensor 133 has a unique serial number #j.

As for each linear positioning sensor 133(#j), after simultaneouslyreceiving all scattering light source 112 emitted by the point lightsource 111(#k) and a synchronization scan signal SYNC, each linearpositioning sensor 133(#j) can calculate and output a group of imagemean position 139 (having a value of μ_(ijk)). In a more specific way,the image mean position 139(μ_(ijk)) is defined as the mean position ofthe line image of a point light sources 111(#k) formed by the linearpositioning sensor 133(#j) in the 1D optical positioning device 131(#i).

The positioning calculation control microprocessor 145 contains apositioning calculation and control procedure and is connected tocontrol all linear positioning sensor 133(#j) and the two-axis angularcontrol device 180. After receiving the synchronization enable signalENABLE outputted by the control analysis procedure 190 through thesignal transmission interface 146, the positioning calculation andcontrol procedure outputs a periodic synchronization scan signal SYNC,and after obtaining all image mean positions 139(μ_(ijk)), thepositioning calculation and control procedure calculates and outputs thephysical quantity P_(i), group physical quantity P_(i) , relativephysical quantity R_(i), and other physical quantities F_(i) of allpoint light sources 111(#k). In addition, the positioning calculationand control procedure in the microprocessor 145 is capable of changingthe visual axis angle (Θ_(i),φ_(i)) of the 1D optical positioning device131(#i). In other words, by receiving a new visual axis angle(Θ_(i),φ_(i)), or by calculating and outputting a new visual axis angle(Θ_(i),φ_(i)) according to the physical quantity P_(i) or the groupphysical quantity P_(i) , the positioning calculation and controlprocedure can calculate and output two angular driving signals(Θ_(ia),φ_(ia)). In the meantime, two angular electric signals(Θ_(is),φ_(is)) is received and used for the feedback control of theangle to achieve the tracking and precise positioning of the visual axisangle. Therefore, the way of using an externally generated new visualaxis angle (Θ_(i),φ_(i)) to change the visual axis angle is known as thevisual axis positioning function and the way of using a new visual axisangle (Θ_(i),φ_(i)) generated by the group physical quantity P_(i) tochange the visual axis angle is known as the visual axis trackingfunction.

As described above, the physical quantity P_(i) of each point lightsource 111(#k) are physical quantities comprising 3D positioncoordinates (x_(ik),y_(ik),z_(ik)), a displacement(Δx_(ik),Δy_(ik),Δz_(ik)), a velocity (v_(xik),v_(yik),v_(zik)), anacceleration (a_(xik),a_(yik),a_(zik)) of the point light source111(#k). The group physical quantity P_(i) comprises group centercoordinates ( x_(i) , y_(i) , z_(i) ), a group average displacement (Δx_(i) , Δy_(i) , Δz_(i) ), a group average velocity ( v_(xi) , v_(yi) ,z_(zi) ), and a group average acceleration ( a_(xi) , a_(yi) , a_(zi) )defined as follows:

Group Center Coordinates:

$\begin{matrix}{{{\overset{\_}{x}}_{i} = {\sum\limits_{k = 1}^{N}{x_{ik}/N}}},{{\overset{\_}{y}}_{i} = {\sum\limits_{k = 1}^{N}{y_{ik}/N}}},{{\overset{\_}{z}}_{i} = {\sum\limits_{k = 1}^{N}{z_{ik}/N}}}} & (39)\end{matrix}$

Group Average Displacement:

$\begin{matrix}{{{\overset{\_}{\Delta \; x}}_{i} = {\sum\limits_{k = 1}^{N}{\Delta \; {x_{ik}/N}}}},{{\overset{\_}{\Delta \; y}}_{i} = {\sum\limits_{k = 1}^{N}{\Delta \; {y_{ik}/N}}}},{{\overset{\_}{\Delta \; z}}_{i} = {\sum\limits_{k = 1}^{N}{\Delta \; {z_{ik}/N}}}}} & (40)\end{matrix}$

Group Average Velocity

$\begin{matrix}{{{\overset{\_}{v}}_{xi} = {\sum\limits_{k = 1}^{N}{v_{xik}/N}}},{{\overset{\_}{v}}_{yi} = {\sum\limits_{k = 1}^{N}{v_{yik}/N}}},{{\overset{\_}{v}}_{zi} = {\sum\limits_{k = 1}^{N}{v_{zik}/N}}}} & (41)\end{matrix}$

Group Average Acceleration

$\begin{matrix}{{{\overset{\_}{a}}_{xi} = {\sum\limits_{k = 1}^{N}{a_{xik}/N}}},{{\overset{\_}{a}}_{yi} = {\sum\limits_{k = 1}^{N}{a_{yik}/N}}},{{\overset{\_}{a}}_{zi} = {\sum\limits_{k = 1}^{N}{a_{zik}/N}}}} & (42)\end{matrix}$

Where, N is the number of point light sources.

Further, the physical quantity P_(i) of each point light source 111(#k)and the group physical quantity P_(i) can be used for calculating arelative physical quantity R_(i) which is a physical quantity describinga physical status constructed between two of the point light sources ora physical status constructed between each point light source and thegroup center coordinates. Thus, the relative physical quantity R_(i) canbe a relative position, a relative velocity, a relative acceleration,angle, angular velocity, angular acceleration or plan vector constructedby the point light sources. If the mass of each point light source isgiven, other physical quantities F_(i) including the force, torque,centripetal force, momentum and kinetic energy can be calculated also.

The signal transmission interface 146 can be a cable or a wirelesstransmitting device for linking the positioning calculation controlmicroprocessor 145 with the control analysis procedure 190 to transmitphysical quantities P_(i), P_(i) , R_(i), F_(i) the visual axis angles(Θ_(i),φ_(i)) and the synchronization enable signal ENABLE.

The pilot point light sources 160 is composed of a plurality of pointlight sources and installed and fixed at a known position of the 1Doptical positioning device fixation mechanism 170, and is used for theposition measurement and the visual axis angle positioning of the 1Doptical positioning device 131(#i).

In FIG. 12( b), a reference coordinates system ( X_(i) , Y_(i) , Z_(i) )is virtually set at an appropriate position of each 1D opticalpositioning device 131(#i) wherein (X_(i0),Y_(i0),Y_(i0)) is the origincoordinates of the coordinates system and Z_(i) axis indicates thevisual axis. Since the pilot point light sources 160 are installed andfixed at known positions, therefore, the position of the origincoordinates (X_(i0),Y_(i0),Y_(i0)) and the visual axis angle(Θ_(i),φ_(i)) can be obtained by the measurement of the positions of thepoint light sources 160.

With reference to FIG. 12( c), before the actual operation of all 1Doptical positioning devices 131 (such as #0,#1,#2), the control analysisprocedure 190 must select one of the 1D optical positioning devices 131(such as #0) as a master positioning device and set ( X₀ , Y₀ , Z₀ ) asa world coordinates system and set(0,0,0) as its original coordinate,while define the rest of 1D optical positioning devices 131 (such as#1,#2) as the client positioning devices. Then, the master positioningdevice (#0) is used to measure the position of the pilot point lightsources 160 installed on the client positioning devices (#1,#2), so asto obtain the original coordinates, such as (X₁₀,Y₁₀,Z₁₀) and(X₂₀,Y₂₀,Z₂₀) and the visual axis angle, such as (Θ₁,φ₁) and (Θ₂,φ₂), ofeach client positioning devices(#1,#2).

With reference to FIG. 12( a), two-axis angular control devices 180 arecomposed of two actuators 181, two angular sensors 182 and a two-axisrotation mechanism (not shown in the figure). After receiving theangular driving signal (Θ_(ia),φ_(ia)), the two-axis angular controldevice 180 drives the two actuators 181 to rotate the two-axis rotationmechanism and the two angular sensors 182 according to the magnitude ofthe angular driving signal (Θ_(ia),φ_(ia)). While the two angularsensors 182 can output and feed back two angular electric signals(Θ_(is),φ_(is)) according to the magnitude of the actual rotation, so asto achieve the angular positioning effect for the two-axis rotationmechanism. Thus the two-axis rotation mechanism can rotate the 1Doptical positioning device fixation mechanism 170 and change the visualaxis angle (Θ_(i),φ_(i)) of the 1D optical positioning device 131(#i).

With reference to FIG. 12( a), the 1D optical positioning devicefixation mechanism 170 is a mechanical mechanism for installing andfixing the plurality of linear positioning sensors 132, the positioningcalculation control microprocessor 145, the signal transmissioninterface 146, and the pilot point light sources 160, and can beconnected to the two-axis rotation mechanism of the two-axis angularcontrol device 180, so as to achieve the two-axis rotation effect.

With reference to FIG. 12( d) for a schematic view of an assembly of alinear positioning sensor 133(#j), the assembly comprises a 1D opticalelement 134, a linear optical sensor 135, a signal processingmicroprocessor 136, and a linear positioning sensor fixation mechanism137.

The 1D optical element 134 is composed of a filter, a linear aperture,and 1D optical lens (not shown in the figure) for forming a line imagefrom a point light source 112. The linear optical sensor 135 is composedof a linear optical sensor array, an electronic scan and read circuitand an analog-to-digital converter (ADC) (not shown in the figure).According to the received scanning timing signal SCAN, the electronicscan and read circuit sequentially and continuously read and output theanalog voltage sensed by each photosensitive pixel, then uses theanalog-to-digital converter (ADC) to convert the analog voltage andoutput a digital voltage. As described above, the outputted digitalvoltage becomes an image superposed signal I_(ij)(x), wherein thesubscripts i and j have the same definitions as the #i,#j.

The signal processing microprocessor 136 is connected to control thelinear optical sensor 135. The signal processing microprocessor 136starts to execute a signal processing procedure to output a scanningtiming signal SCAN according to the received synchronization scan signalSYNC and read the image superposed signal I_(ij)(x), so as to calculateand output the image mean position 139(μ_(ijk)) of all point lightsources. The signal processing procedure comprises a synchronous dataacquisition procedure, a dynamic background light signal eliminationprocedure and an image signal recognition and correspondence procedure.

According to the timing of the received synchronization scan signalSYNC, the synchronous data acquisition procedure outputs a scanningtiming signal SCAN at a proper time later after the synchronization scansignal SYNC, so as to obtain and record the image superposed signalI_(ij)(x) which contains the effective image signal formed by all pointlight sources and the dynamic background light signal.

The dynamic background light signal elimination procedure comprising anelimination procedure of time dependent ambient light interferencesignal and an elimination procedure of space dependent ambient lightinterference signal is able to reduce the dynamic background lightsignal from the image superposed signal I_(ij)(x), so as to output aneffective image signal of all point light sources.

The image signal recognition and correspondence procedure mainlyutilizes a threshold comparison and/or a profile detection method toanalyze and recognize the effective image signal of all point lightsources and obtain the correspondence relationship. As for the profiledetection method, the method uses the characteristics of the effectiveimage signal such as the standard deviation σ, the central intensity I₀and the slope of the waveform to achieve the purpose of analysis,recognition and correspondence. In addition, when the geometricmodulation is adopted by the point light sources, a method of deductionand a Gaussian Fitting are used to analyze and recognize the effectiveimage signal of all point light sources and obtain the correspondencerelationship.

As for the calculating process of the image mean position, severalanalytic processes such as the analysis of the position of the brightestsensed pixel, the analysis of Gaussian Fitting and the analysis ofstatistics are applied to each analyzed and recognized effective imagesignal for calculating and outputting each image mean position(μ_(ijk)).

Further, the linear positioning sensor fixation mechanism 137 is amechanical mechanism for installing and fixing the 1D optical element134, the linear optical sensor 135 and the signal processingmicroprocessor 136, and is installed and fixed into the 1D opticalpositioning device fixation mechanism 170.

With reference to FIGS. 12( e) to 12(i) for schematic views of ageometric structural relation among the 1D optical positioning devicefixation mechanism 170, the linear positioning sensor fixation mechanism137 and the pilot point light sources 160.

In FIG. 12( e), the 1D optical positioning device fixation mechanism 170is a triangular geometric structure, preferably an equilateral trianglestructure. The linear positioning sensor fixation mechanism 137 can beinstalled at the vertices or the middle of three sides of the triangulardevice 170. In other words, the relative installed positions of threelinear positioning sensors 133 constitute a triangular geometricstructure. In addition, the linear positioning sensor 133(#j) can be setto any angle by the rotation about its optical axis. In other words, thedirection of a long axis of the 1D optical lenses in three linearpositioning sensors 133 can be set to any angle.

The pilot point light source 160 composed of a plurality of point lightsources can be installed at any position of the triangular 1D opticalpositioning device fixation mechanism 170, and preferably having threepoint light sources, and the installed position is preferably at thevertices or the middle of three sides of the triangular.

A connecting structure 171 can be installed at the vertices of thetriangular 1D optical positioning device fixation mechanism 170, and theconnecting structure 171 includes a structure which can connect ordetach (not connect) two sides of a triangle, and can freely adjust theangle included between any two sides of the triangle. For example, thetriangular geometric structure can be transformed into a linearstructure.

In the improvement of the preferred embodiment as shown in FIG. 12( f),a connecting mechanism is added to the middle of any one of three sidessuch that an extra linear positioning sensor is installed and the extralinear positioning sensor is installed at the center of the triangle.

With reference to FIG. 12( g) for another improvement of the foregoingembodiment, the triangular geometric structure is changed to aquadrilateral geometric structure, preferably an equilateralquadrilateral structure, and the number of installed linear positioningsensors is increased to four.

With reference to FIG. 12( h) for another improvement of the foregoingembodiment, the triangular geometric structure is changed to apentagonal geometric structure, preferably an equilateral pentagon, andthe number of installed linear positioning sensor is increased to five.

With reference to FIG. 12( i) for another improvement of the foregoingembodiment, the triangular geometric structure is changed to a hexagonalgeometric structure, preferably an equilateral hexagon structure, andthe number of installed linear positioning sensor is increased to six.Of course, such structure can be expanded to a n-sided polygonalgeometric structure.

In FIG. 12( j), the 1D optical positioning device fixation mechanism 170can be a casing of other conventional devices such as a notebookcomputer, a video game player, a PDA, a mobile phone, a liquid crystaldisplay, a plasma display, a television, a projector, an optical camera,an optical camcorder, an optical telescope, an automobile or amotorcycle (the figure only shows the casings of a notebook computer anda liquid crystal display). In the present invention, the plurality oflinear positioning sensors 132, a positioning calculation controlmicroprocessor 145, a signal transmission interface 146 and the pilotpoint light sources 160 can be installed on the casing of theaforementioned conventional devices to achieve the effects of a 3Dposition measurement, a virtual input, or a simulator.

With reference to FIG. 13( a) for a schematic view of a control analysisprocedure, the control analysis procedure 190 is a software procedureand comprises an coordinate alignment and synchronization calibrationprocedure 191, a device simulated input procedure 192 and simulatorprocedure 193. The control analysis procedure 190 can be integrated andinstalled in other devices 194 such as a personal computer, a notebookcomputer, a PDA, a mobile phone, or a video game player and a videoplaying and a converting equipment (DVD or STB), and uses an electronicsystem such as a microprocessor in the mentioned device 194 to executethree procedures.

With reference to FIG. 13( b) for a schematic view of a coordinatealignment and synchronization calibration procedure, the procedure 191comprise a visual axis reset procedure, a coordinate transformationsetting procedure and a synchronous timing calibration procedure, so asto obtain the coordinate transformation relationship between each 1Doptical positioning device, and compensate the positioning error causedby the coordinate transformation, and correct the error of synchronoustiming.

By utilizing the visual axis control procedure installed in the 1Doptical positioning device 131 with a visual axis tracking function, thevisual axis reset procedure can point the visual axes of 1D opticalpositioning device 131 all at a positioning point light source 111 andthus set the angles of each visual axes at zero degree, i.e.(Θ_(i)=0,φ_(i)=0). The coordinate transformation setting procedureselects one of the 1D optical positioning device 131 as a materpositioning device 131(#0) and selects the others as client positioningdevices 131(#i). In such a way that the mater positioning device(#0)measures the position of the positioning point light source 111 and eachpilot point light sources 160 of all client positioning devices(#i), andeach client positioning device(#i) measures the position of thepositioning point light source 111, the coordinate transformationrelationship between the mater positioning device(#0) and the clientpositioning devices(#i) and the compensation of the positioning errorare obtained. In addition, the synchronous timing calibration procedureperiodically outputs a synchronization enable signal ENABLE in a propercycle of time interval, such that all positioning device 131 can becalibrated to execute the positioning calculation and control proceduresynchronously.

In addition, in FIG. 13( a), the device simulated input procedure 192,mainly comprising a procedure of virtual operating screencorrespondence, a procedure of virtual device geometric structuredefinition and operating fingers correspondence and a procedure ofoperating gestures definition and recognition, simulates and recognizesthe operation of a hand or fingers required by a physical input device,so as to achieve the virtual input effect.

As to a physical operating screen with an actual dimensions, theprocedure of virtual operating screen correspondence defines a virtualoperating screen at any position in the space. The virtual operatingscreen has a spatial corresponding relationship with the physicaloperating screen, and the relationship is a one-to-one correspondingrelation such as a magnifying corresponding relation, an equivalentcorresponding relation and a shrinking corresponding relation. Inaddition, by taking the advantage of virtual reality technology, thevirtual operating screen can be visually displayed as a virtual stereoimage.

As to a physical input device, the procedure of virtual device geometricstructure definition and operating fingers correspondence defines ageometric structure of a virtual device, a physical position and size ofthe virtual function keys and the physical motion of the virtualfunction keys; and corresponds the operating fingers to the virtualfunction keys. In addition, by taking the advantage of virtual realitytechnology, the geometric structure of the virtual device and operatingfingers can be visually displayed as a virtual stereo image.

According to the physical motion of the virtual function keys, theprocedure of operating gestures definition and recognition defines thephysical movement quantities of the operating fingers. The physicalmovement quantities are a set of consecutive time dependent physicalquantities. The set of physical quantities contains the physicalquantities, group physical quantities, relative physical quantities andother physical quantities of all point light sources. According to thesepredefined physical quantities, the gestures of operating fingers can berecognized by measuring and analyzing the motion of point light sourcesinstalled on the fingers, so as to achieve the device simulated inputpurpose.

With reference to FIG. 13( a), the simulator procedure 193 measures thepositions of those point light sources installed on a physical object inreal time, so as to calculate the trajectory and physical movementquantities of the physical object. In addition, taking the advantage ofa virtual image and physical laws, the physical object (such as aracket) and a virtual image (such as a ball) can do an interaction(suchas striking the ball) in a lively and natural way, so as to achieve thesimulation purpose of sports, shooting, driving and flying.

Further, the simulator procedure 193 measures the positions of thosepoint light sources installed on a physical object in real time, so asto calculate the trajectory and physical movement quantities of thephysical object. In addition, taking the advantage of virtual realitytechnology, a virtual object is defined in the virtual space and itsmotion is corresponded to the motion of the physical object (such as aracket). In conformity with the physical laws, the virtual object isable to interact with other virtual object (such as a ball) in a livelyand natural way (such as striking the ball), so as to achieve thesimulating purpose of sports, shooting, driving and flying.

With reference to FIG. 14 for a schematic view of a second preferredembodiment, as for the unique characteristic of the point light sources,a device 200 of the second preferred embodiment mainly adopts thewavelength modulation method and has a same system structure as the onedisclosed in the first preferred embodiment. Only the difference isdescribed as follow.

The device 200 in the present embodiment mainly comprises a plurality ofpoint light sources with unique wavelength 210, a plurality of 1Doptical positioning devices with a visual axis tracking function 230 anda control analysis procedure 290. For clear illustration, R, G and B areused as an example to illustrate the unique characteristic of wavelengthfor the point light source 211.

The difference is described as follow:

(1) As for the plurality of point light sources with unique wavelength210, each point light source has a different light emitting wavelengthand all point light sources emit light simultaneously and continuously(refer to the above descriptions related to FIG. 5( d)).

(2) As for the linear optical sensor (not shown in the figure), which isinstalled in the linear positioning sensor in each 1D opticalpositioning devices with a visual axis tracking function 231, iscomposed of one or a plurality of 1D color optical sensor arrays or a 2Dcolor optical sensor array. Different color filters are attached ontothe photosensitive pixels of 1D or 2D color optical sensor array andused to filter and separate those multiple point light sources withdifferent emitting wavelengths. Namely, each color filter allows itscorresponding point light source to transmit but block outnon-corresponding point light sources (refer to the above descriptionsrelated to FIG. 5( e), FIG. 5( f) and FIG. 5( g)).

In addition, according to the unique characteristics, the composition ofthe unique characteristics of the plurality of point light sources canbe a combination of the uniqueness of intensity, geometric size andwavelength. In other words, such a combination is an applicationintegrated by the first and second embodiment. For instance, as to threesets of point light sources, each set of point light sources is composedof a plurality of point light sources; and as to the composition of theunique characteristics, each set has the unique wavelengthcharacteristics (such R, G, B wavelength), while each point light sourcein each set may have the unique intensity characteristics or uniquegeometric size characteristics. Principle and effect of such combinationhas been disclosed in the above description and it is no necessary torepeat it again.

With reference to FIG. 15( a) for a schematic view of the thirdpreferred embodiment, as for the unique characteristics of the pointlight sources, the present embodiment mainly adopts an improved methodof a time modulation, namely Master/Client Wireless SynchronizationMethod, and has a same system structure as the one disclosed in thefirst preferred embodiment. Only the difference is described as follow.

The device 300 in the present embodiment mainly comprises a moduledevice of multiple point light sources 311, a plurality of 1D opticalpositioning devices with a visual axis tracking function 330 and acontrol analysis procedure 390. For the clear illustration, a whitecircle is used as an example to illustrate the unique characteristic ofemitting time for the point light sources 312.

The difference is described as follow:

(1) The point light sources 312 in the module device of multiple pointlight sources 311 receives a coded RF synchronous signal 320, wherebyeach point light source alternately emits a point-like scattering light313 at the different time.

(2) Each 1D optical positioning devices 331 in 1D optical positioningdevices with a visual axis tracking function 330 mainly emits orreceives a coded RF synchronous signal 320, and receives the scatteringlight 313 emitted by the point light sources, so as to analyze,calculate and output the physical quantities 350 of all point lightsources 312.

With reference to FIG. 15( b) for a schematic view of a module device ofmultiple point light sources, the module device 311 comprises a RFreceiver 314, a switch 315 and a plurality of point light sources. TheRF receiver 314 comprises a RF antenna, a RF demodulator and decoder(not shown in the figure), and receives the coded RF synchronous signal320, so as to analyzes and outputs an encoding signal 24 and asynchronous signal 25 (refer to FIG. 4( d)). According to the receivedencoding signal 24 and a synchronous signal 25, the switch 315continuously and alternately lights each point light sources 312, so asto achieve the effect of time modulation.

With reference to FIG. 15( c) for a schematic view of a 1D opticalpositioning devices with a visual axis tracking function, beingdifferent from the composition in the first embodiment, the 1D opticalpositioning devices 331 comprises one more RF transmitter 332 foremitting or receiving the coded RF synchronous signal 320 which isgenerated by the positioning calculation control microprocessor 345. Theencoding signal in the coded RF synchronous signal 320 can be composedof a group of binary codes, a square wave with specific time duration,or a specific number of pulses. If the 1D optical positioning devices331 is selected as a master device, then the RF transmitter 332 is usedto emit the coded RF synchronous signal 320. If the 1D opticalpositioning devices 331 is selected as a client device, then the RFtransmitter 332 is used to receive the coded RF synchronous signal 320and also produces a synchronization scan signal SYNC to synchronouslydrive all linear optical sensors, so as to obtain the image signal ofthe uniquely lit point light source.

FIG. 16 shows the schematic view of the fourth preferred embodiment ofthe present invention.

The fourth embodiment adopts an improved method which is an integrationof the first, second and third embodiment, namely is an application thatcombines the uniqueness of intensity, geometric size, wavelength andtime, and has a same system structure as the one disclosed in the firstpreferred embodiment. Only the difference is described as follow. Forthe clear illustration, the white circles are used as an example toillustrate the unique characteristic of emitting time for the moduledevice of point light sources 411.

The device 400 in the present embodiment mainly comprises a plurality ofmodule devices with multiple point light sources 410, a plurality of 1Doptical positioning devices with a visual axis tracking function 430 anda control analysis procedure 490.

The difference is described as follow:

(1) Each module device with multiple point light sources 411 in theplurality of module devices 410 comprises a RF receiver 414, a switch(not shown in the figure) and a plurality of point light sources 412.The unique characteristics of the plurality of point light sources 412can be the unique intensity, the unique geometric size or the uniquewavelength. The RF receiver 414 receives the coded RF synchronous signal420, so as to simultaneously light up all point light sources 412 foremitting a point-like scattering light source with unique characteristic413. In addition, the coded RF synchronous signal 420 comprises anencoding signal and a synchronous signal (not shown in the figure). Theencoding signal represents the number of a module device to be lit, andthe synchronous signal represents the timing of the point light sources412 to be lit. Namely, each module device 411 has a uniquecharacteristic of time. By utilizing the RF receiver 414, the encodingsignal and the synchronous signal can be separated and decoded toalternately light up each module device 411 at a different time.

(2) Each 1D optical positioning devices 431 in the plurality of 1Doptical positioning devices with a visual axis tracking function 430 ismainly able to emit or receive a coded RF synchronous signal 420 andsynchronously receive the scattering light source 413 emitted by thepoint light sources 412, so as to calculate and output the physicalquantities 450 of all point light sources 412.

FIG. 17 shows the schematic view of the fifth preferred embodiment ofthe present invention.

The fifth embodiment is an integration of the second and thirdembodiment, namely, is an application that combines the uniqueness ofwavelength and time, and has a same system structure as the onedisclosed in the fourth preferred embodiment. Only the difference isdescribed as follow.

The device 500 in the present embodiment mainly comprises a plurality ofmodule devices with multiple point light sources 510, a plurality of 1Doptical positioning devices with a visual axis tracking function 530 anda control analysis procedure 590. For the clear illustration, the whitecircle is used as an example to illustrate the unique characteristic ofemitting time of the point light sources 512 in the module device 511and R, B are used as an example to illustrate the unique characteristicof wavelength for the module device 511.

The difference is described as follow:

(1) Each module device with multiple point light sources 511 comprises aRF receiver 514, a switch (not shown in the figure) and a plurality ofpoint light sources 512, and has a unique characteristic of wavelength,namely all point light sources 512 in the same module device 511 havethe same emitting wavelength. After the RF receiver 514 receives thecoded RF synchronous signal 520, all module devices 511 synchronouslylight one of the point light sources in the module device and let allpoint light sources in the same module device can be lit alternately. Inother words, as to all point light sources 512 in the module device 511,each point light source has the uniqueness of time and is litalternately, while as to all module device 511, each module device has auniqueness of wavelength and are lit synchronously. In addition, thecoded RF synchronous signal 520 comprises an encoding signal and asynchronous signal (not shown in the figure). The encoding signalrepresents the number of a point light source in the module device 511to be lit, and the synchronous signal represents the timing of the pointlight sources 512 to be lit. By utilizing the RF receiver 514, theencoding signal and the synchronous signal can be separated and decodedto alternately light each point light source 512 in all module device511.

(2) Each 1D optical positioning devices 531 in the plurality of 1Doptical positioning devices with a visual axis tracking function 530 ismainly able to emit or receive a coded RF synchronous signal 520 andsynchronously receives the scattering light source 513 emitted by thepoint light sources 512, so as to calculate and output the physicalquantities 550 of all point light sources 512.

FIG. 18 shows the schematic view of the sixth preferred embodiment ofthe present invention.

As for the unique characteristics of the point light sources, the sixthembodiment adopts another improved time modulation method, namely theaforementioned the improved Stephenson's method, and has a same systemstructure as the one disclosed in the first preferred embodiment. Onlythe difference is described as follow.

The device 600 in the present embodiment mainly comprises a moduledevice of multiple point light sources 611, a plurality of 1D opticalpositioning devices with a visual axis tracking function 630 and acontrol analysis procedure 690.

The difference is described as follow:

(1) One more switch 614 is installed in the module device of multiplepoint light sources 611, and is used to continuously and alternatelylight the point light sources 612 for emitting a point-like scatteringlight source 613 at a constant period.

(2) An optical receiver 632 installed in each 1D optical positioningdevices 631 is used to receive the light sources 613 emitted by thepoint light sources 612 and output a lighting timing signal of the pointlight sources 612 (refer to the above descriptions related to FIG. 4(c)). The positioning calculation control microprocessor (not shown inthe figure) in the 1D optical positioning devices 631 is used to receivethe lighting timing signal at a proper time and thus measure the periodof the continuous and alternate lighting timing of the point lightsources 612, and synchronously generate a synchronization scan signalSYNC with the same period, so as to synchronously drive all linearoptical sensors to scan and read the image superposed signals.

The basic arts, system configurations and applications have beendisclosed in the present invention and brief conclusions are given asfollow:

1. Processing Art of Unique Characteristics of Point Light Source,includes:

(1) Processing Art of Intensity Modulation Method;

(2) Processing Art of Geometric Modulation Method;

(3) Processing Art of Wavelength Modulation Method;

(4) Art of Master/Client Wireless Synchronization Method;

(5) Art of Improved Stephenson's Method;

2. Eliminating Art of Dynamic Background Light Interference, includes:

(1) Real Time Eliminating Art of Time Dependent Ambient LightInterference Signal;

(2) Approximated Real Time Eliminating Art of Time Dependent AmbientLight Interference Signal;

(3) Eliminating Art of Space Dependent Ambient Light InterferenceSignal(Method of Fourier Signal Process);

3. Art of Data Process, includes:

(1) Art of Profile Detection Method;

(2) Art of Spatial Resolution Calculation;

(3) Art of Mean Position Calculation;

4. Art of System Configurations Extension, includes:

(1) Art of Blind Spot Compensation;

(2) Art of Viewing Angle Expansion;

(3) Art of Visual Axis Tracking;

(4) Art of Coordinate Alignment and Synchronization calibration;

5. Art of System Applications Extension, includes:

(1) Art of Virtual Input Applications;

(2) Art of Simulator Applications;

In view of the above disclosed basic arts, system configurations,applications and embodiments in the present invention, although the allrelated description is dedicated in 1D optical system, theaforementioned basic arts, system configurations and applications arealso available for 2D optical system which adopts the 2D lens and 2Doptical sensor array. Such as the positioning coordinate calculation ofthe point light sources, the elimination of the dynamic background lightinterference, the process of data and the number of the used opticalsensor are the primary differences between 1D and 2D system. As for thepositioning coordinate calculation for 2D optical system, the detailshave been disclosed in R.O.C. Pat. Application No.: 096108692 and it isno necessary to describe it again. In addition, as for the eliminationof the dynamic background light interference and the process of data,the necessary process and calculation can be extended from 1D to 2D byusing the same analytic logics. As for the number of the used opticalsensor, the least number used in 1D optical system is three, while theleast number used in 2D optical system is two.

What is claimed is:
 1. A three-dimensional virtual input and simulationapparatus, comprising: a plurality of point light sources, each pointlight source being capable of simultaneously and continuously emitting apoint-like scattering light source; a plurality of 2D opticalpositioning devices with a visual axis tracking function, each 2Doptical positioning devices receiving a synchronization enable signaland all scattering light sources simultaneously emitted by the pointlight sources, whereby measuring the 3D positions of all point lightsources and outputting a set of physical quantities, each 2D opticalpositioning devices being equipped with a visual axis tracking functionfor automatically tracking the central group coordinate of all pointlight sources and the coordinate of one of the point light sources andoutputting a visual axis angle of its own visual axis, so as to achievethe visual axis tracking purpose, and each 2D optical positioningdevices further being equipped with a visual axis positioning functionto receive a visual axis angle for setting the angular direction of itsown visual axis, so as to achieve the visual axis positioning purpose;and a control analysis procedure, being a software procedure mainly usedto connect and control all 2D optical positioning devices, outputting asynchronization enable signal for synchronously starting all 2D opticalpositioning devices to do the 3D position measurement, and alsooutputting a set of angular direction of visual axis for setting theangular direction of visual axis of each 2D optical positioning devices,so as to achieve the visual axis positioning purpose for all 2D opticalpositioning devices, and further receiving all physical quantities and agroup of a visual axis angles to simulate an input function of aphysical input device, so as to achieve the virtual input purpose, andalso to simulate the motion of a physical object, so as to achieve thepurpose of simulator.
 2. Three-dimensional virtual input and simulationapparatus of claim 1, wherein each point light source in the pluralityof point light sources has a unique characteristic of light intensity,preferably has a light emission with an equal light emitting radius buta different light emitting intensity.
 3. Three-dimensional virtual inputand simulation apparatus of claim 1, wherein each point light source inthe plurality of point light sources has a unique characteristic ofgeometric size, preferably has a light emission with a different lightemitting radius but an equal light emitting intensity. 4.Three-dimensional virtual input and simulation apparatus of claim 1,wherein each point light source in the plurality of point light sourceshas a unique characteristic of wavelength, preferably has a lightemission with a different light emitting wavelength and each wavelengthis not overlapped.
 5. Three-dimensional virtual input and simulationapparatus of claim 4, wherein the number of the plurality of point lightsources is three, and the light emitting wavelength of each point lightsource are the red, green and blue light.
 6. Three-dimensional virtualinput and simulation apparatus of claim 1, wherein the composed uniquecharacteristics of the plurality of point light sources is a combinationof light intensity, geometric size and wavelength.
 7. Three-dimensionalvirtual input and simulation apparatus of claim 1, wherein the single 2Doptical positioning devices with a visual axis tracking functioncomprises: a plurality of 2D positioning sensors, for receiving asynchronization scan signal and simultaneously receiving all scatteringlight sources emitted by the point light sources, and calculating andoutputting the 2D image mean positions of all point light sources; apositioning calculation control microprocessor, containing a positioningcalculation and control procedure, being connected to control all 2Dpositioning sensors and a two-axis angular control device, thepositioning calculation and control procedure mainly receiving asynchronization enable signal, all 2D image mean positions, a visualaxis angle and two feedback angular electric signals, so as to calculateand output a synchronization scan signal, a set of physical quantities,a visual axis angle and two angular driving signals; a signaltransmission interface, being a wire or a wireless transmitting device,for transmitting a set of physical quantities, a visual axis angle and asynchronization enable signal; a group of pilot point light sources,composed of a plurality of point light sources, and installed and fixedat known positions of the 2D optical positioning device fixationmechanism, and used for the position measurement and the visual axisangle positioning of the 2D optical positioning device; a 2D opticalpositioning device fixation mechanism, being a mechanical structure, forinstalling and fixing the plurality of 2D positioning sensors, thepositioning calculation control microprocessor, the signal transmissioninterface and the group of pilot point light sources, and connected tothe two-axis rotation mechanism in the two-axis angular control deviceto achieve a two-axis rotation effect; and a two-axis angular controldevice, composed of two actuators, two angular sensors and a two-axisrotation mechanism, for receiving the angular driving signal and drivingthe two actuators to rotate the two-axis rotation mechanism and the twoangular sensors according to the magnitude of the angular drivingsignal, the two angular sensors outputting two angular electric signalsas feedback signals according to the magnitude of the actual rotation,so as to achieve the angular positioning effect for the two-axisrotation mechanism, and the two-axis rotation mechanism rotating the 2Doptical positioning device fixation mechanism, so as to change thevisual axis angle of the 2D optical positioning device. 8.Three-dimensional virtual input and simulation apparatus of claim 7,wherein the single 2D positioning sensor comprises: a 2D opticalelement, comprising a filter, a 2D aperture, and 2D optical lens; a 2Doptical sensor, comprising a 2D optical sensor array, an electronic scanand read circuit and an analog-to-digital converter, and the electronicscan and read circuit sequentially and continuously reading andoutputting an analog voltage sensed by each photosensitive pixel of the2D optical sensor array according to the received scanning timingsignal, and the analog-to-digital converter converting the analogvoltage and outputting a digital voltage which is the 2D imagesuperposed signal; a signal processing microprocessor, being connectedto control the 2D optical sensor, for receiving the synchronization scansignal to start the execution of a signal processing procedure to outputa scanning timing signal and read the 2D image superposed signal, so asto calculate and output the 2D image mean position of all point lightsources.; and a 2D positioning sensor fixation mechanism, being amechanical structure, for installing and fixing the 2D optical element,the 2D optical sensor, and the signal processing microprocessor, andbeing installed and fixed in the 2D optical positioning device fixationmechanism.
 9. Three-dimensional virtual input and simulation apparatusof claim 8, wherein the 2D optical sensor is composed of a 2D opticalsensor array, an electronic random access circuit and ananalog-to-digital converter, the electronic random access circuit uses amicroprocessor, a row decoder and a column decoder to read a pixeldirectly and randomly.
 10. Three-dimensional virtual input andsimulation apparatus of claim 8, wherein the signal processing procedurecomprises: a synchronous data acquisition procedure, for receiving thesynchronization scan signal, and outputting a scanning timing signal ata proper time, so as to obtain and record the 2D image superposed signalwhich contains the 2D effective image signal formed by all point lightsources and the 2D dynamic background light signal; a 2D dynamicbackground light signal elimination procedure, comprising an eliminationprocedure of time dependent 2D ambient light interference signal and anelimination procedure of space dependent 2D ambient light interferencesignal, and being able to eliminate the 2D dynamic background lightsignal from the 2D image superposed signal, so as to output a 2Deffective image signal of all point light sources; a 2D image signalrecognition and correspondence procedure, mainly utilizing a 2Dthreshold comparison and/or a 2D profile detection method to analyze andrecognize the 2D effective image signal of all point light sources andobtain the correspondence relationship, the 2D profile detection methodusing the characteristics of the 2D standard deviation, the centralintensity and the 2D slope of the waveform to achieve the purpose ofanalysis, recognition and correspondence; and a 2D image mean positioncalculation procedure, for applying several analytic processes, such asthe analysis of the position of the brightest sensed pixel, the analysisof 2D Gaussian Fitting and the analysis of 2D statistics to each 2Deffective image signal for calculating and outputting each 2D image meanposition.
 11. Three-dimensional virtual input and simulation apparatusof claim 10, wherein the 2D dynamic background light signal eliminationprocedure is a hardware method which uses one more noise measurement 2Doptical sensor, by utilizing the same scanning timing used by the 2Doptical sensor and a proper signal amplification, the noise measurement2D optical sensor obtains the 2D dynamic background light signalindependently, thus the 2D dynamic background light signal is subtractedfrom the 2D image superposed signal, so as to achieve the purpose of theelimination of the 2D dynamic background light signal, a proper opticalfilter attached to the 2D optical sensor array in the noise measurement2D optical sensor is used to block out the light sources emitted by thepoint light sources but transmit the background light sources. 12.Three-dimensional virtual input and simulation apparatus of claim 10,wherein the elimination procedure of time dependent 2D ambient lightinterference signal is a software method which applies a mathematicsubtraction process to the two consecutively obtained 2D imagesuperposed signals, so as to achieve the purpose of eliminating the 2Ddynamic background light signal.
 13. Three-dimensional virtual input andsimulation apparatus of claim 10, wherein the elimination procedure ofspace dependent 2D ambient light interference signal is a 2D Fouriersignal process, the 2D Fourier signal process first applies a 2D Fouriertransformation to the data obtained by the elimination procedure of timedependent 2D ambient light interference signal, then applies a 2Dbandpass filtering process to the transformed data for reducing theunnecessary frequencies and amplifying the signal in the frequencydomain, and finally applies a 2D inverse Fourier transformation to theprocessed data in the frequency domain, so as to achieve the purpose ofeliminating the space dependent 2D ambient light interference. 14.Three-dimensional virtual input and simulation apparatus of claim 7,wherein the positioning calculation and control procedure comprises: asynchronous scan procedure, for receiving the synchronization enablesignal to periodically generate and output a synchronization scansignal, so as to synchronously drive all 2D positioning sensors to startthe execution of a signal processing procedure; a physical quantitycalculation procedure, for obtaining the image mean positions providedby the 2D positioning sensors and calculating and outputting a set ofphysical quantities, and the set of physical quantities including thephysical quantity, the group physical quantity, the relative physicalquantity, and other physical quantities; and a visual axis controlprocedure, for calculating and outputting a visual axis angle and twoangular driving signals according to the physical quantity, the groupphysical quantity or a visual axis angle, further receiving two feedbackangular electric signals to implement an angular feedback control, so asto achieve the angular positioning control for the visual axis. 15.Three-dimensional virtual input and simulation apparatus of claim 1,wherein the control analysis procedure can be integrated and installedin other devices such as a personal computer, a notebook computer, aPDA, a mobile phone, a game player and a video playing and a convertingequipment.
 16. Three-dimensional virtual input and simulation apparatusof claim 1, wherein the physical input device can be a mouse, akeyboard, a remote control and a touch screen.
 17. Three-dimensionalvirtual input and simulation apparatus of claim 7, wherein the 2Doptical positioning device fixation mechanism can be a casing of otherconventional devices such as a notebook computer, a PDA, a video gameplayer, a mobile phone, a liquid crystal display, a plasma display, atelevision, a projector, an optical camera, an optical camcorder, anoptical telescope, an automobile or a motorcycle, and namely theplurality of 2D positioning sensors, the positioning calculation controlmicroprocessor, the signal transmission interface and the pilot pointlight sources can be installed on the casing of the aforementionedconventional devices.